DOCUMENT RESUME 



ED 400 343 



TM 026 092 



AUTHOR 

TITLE 



INSTITUTION 
SPONS AGENCY 

REPORT NO 
PUB DATE 
NOTE 

AVAILABLE FROM 



PUB TYPE 



Green, Patricia J. ; And Others 

Baccalaureate and Beyond Longitudinal Study: 1993/94 
First Follow-Up Methodology Report* Technical 
Report* 

National Opinion Research Center, Chicago, 111. 
National Center for Education Statistics (ED) , 
Washington, DC. 

ISBN-0- 16-048747- 1 ; NCES-96-149 

Aug 96 

908p. 

U.S. Government Printing Office, Superintendent of 
Documents, Mail Stop: SSOP, Washington, DC 
20402-9328. 

Statistical Data (11 0) — Reports - Descriptive ( 1 4 1 ) 



EDRS PRICE MF06/PC37 Plus Postage. 

DESCRIPTORS Access to Education; *Bachelors Degrees; Cohort 

Analysis; ''College Graduates; Data Analysis; Data 
Collection; ''Educational Attainment; Educational 
Policy; Employment Patterns; Enrollment; v 'Exper i ence ; 
*Followup Studies; Higher Education; Interviews; Life 
Events; Longitudinal Studies; Parents; Research 
Design; Research Methodology; Response Rates 
(Questionnaires); Teacher Education 
IDENTIFIERS ''Baccalaur eate and Beyond Longitudinal Study (NCES) ; 

National Pos t s econdary Student Aid Study; *Rate of 
Return; Weighting (Statistical) 



ABSTRACT 

The Baccalaureate and Beyond Longitudinal Study 
(B&B:93) tracks the experiences of a cohort of recent college 
graduates, those who received the baccalaureate degree during the 
1992-93 academic year and were first interviewed as part of the 
National Postsecondary Student Aid Study. The experiences of this 
group in the areas of academic enrollment, degree completion, 
employment, public service, and other adult decisions will be 
followed for about 12 years. Data will be used to address issues in a 
number of educational policy areas such as educational attainment, 
access to graduate and professional schools, the rate of return on 
educational investment, and patterns of preparation and engagement in 
teaching. The B&B:93 cohort consisted of about 12,500 individuals who 
were determined to be potentially eligible for followup in 1994. 
Responses were obtained for 11,810 students. This report reviews: (l) 
the study purpose and design; (2) the B&B:93 sample design; (3) data 
collection: telephone and field survey procedures; (4) response 
rates; (5) evaluation of the survey instrument; (6) the transcript 
component of B&B:93/94; and (7) the weights development documentation 
for the B&B:93/94 sample. Four appendixes provide additional details 
about methodology and present the student and parent questionnaires 
in table form. (Contains 31 tables, 3 appendix tables, 5 figures, and 
2 references. ) (SLD) 



ED 400 343 



NATIONAL CENTER FOR EDUCATION STATISTICS 



Technical Report 



August 1996 



Baccalaureate and Beyond 
Longitudinal Study: 
1993/94 First Follow-up 
Methodology Report 



l: U.S. DEPARTMENT OF EDUCATION 

1 Office of Educational Research and Improvement 

I EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 

, □ This document has been reproduced as 

received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



• Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 




*! 




U.S. Department of Education 

Office of Educational Research and Improvement NCES 96-149 



NATIONAL CENTER FOR EDUCATION STATISTICS 

Technical Report August 1996 



Baccalaureate and Beyond 
Longitudinal Study: 
1993/94 First Follow-up 
Methodology Report 




Patricia J. Green 
Sharon L. Meyers 
Pamela Giese 
Joan Law 

Howard M. Speizer 
Vicki Staebler Tardino 
National Opinion Research Center 
at the University of Chicago 

Paula Knepper 
Project Officer 

National Center for Education Statistics 



U.S. Department of Education 

Office of Educational Research and Improvement 



NCES 96-149 



U.S. Department of Education 

Richard W. Riley 
Secretary 

Office of Educational Research and Improvement 

Sharon P. Robinson 
Assistant Secretary 

National Center for Education Statistics 

Pascal D. Forgione, Jr. 

Commissioner 

The National Center for Education Statistics (NCES) is the primary federal entity for collecting, 
analyzing, and reporting data related to education in the United States and other nations. It 
fulfills a congressional mandate to collect, collate, analyze, and report full and complete 
statistics on the condition of education in the United States; conduct and publish reports and 
specialized analyses of the meaning and significance of such statistics; assist state and local 
education agencies in improving their statistical systems; and review and report on education 
activities in foreign countries. 

NCES activities are designed to address high priority education data needs; provide consistent, 
reliable, complete, and accurate indicators of education status and trends; and report timely, 
useful, and high quality data to the U.S. Department of Education, the Congress, the states, 
other education policymakers, practitioners, data users, and the general public. 

We strive to make our products available in a variety of formats and in language that is 
appropriate to a variety of audiences. You, as our customer, are the best judge of our success 
in communicating information effectively. If you have any comments or suggestions about this 
or any other NCES product or report, we would like to hear from you. Please direct your 
comments to: 

National Center for Education Statistics 
Office of Educational Research and Improvement 
U.S. Department of Education 
555 New Jersey Avenue NW 
Washington, DC 20208-5574 

August 1996 



Suggested Citation 

U.S. Department of Education. National Center for Education Statistics. Baccalaureate and Beyond Longitudinal 
Study: 1993/94 First Follow-up Methodology Report, NCES 96-149, by Patricia J. Green, Sharon L. Meyers, Pamela 
Giese, Joan Law, Howard M. Speizer, and Vicki StaeblerTardino. Project Officer, Paula Knepper. Washington, DC: 
1996. 



Contact: 

Aurora D’Amico 
(202) 219-1365 



O 

ERIC 



For sale by the U.S. Government Printing Office 
Superintendent of Documents, Mail Stop: SSOP, Washington, DC 20402-9328 

ISBN 0-16-048747-1 



4 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology Re£ort 



Table of Contents 

Acknowledgments v “ 

1. An Overview of the Baccalaureate and Beyond Study 1 

1 . 1 Purpose of the Study 1 

1 .2 Analytic Objectives 1 

1 .3 Study Design 4 

2. B&B:93 Sample Design 5 

2.1 Original NPSAS:93 Sample Design 5 

2.2 B&B Student Sample 6 

2.3 B&B:93 Sample Eligibility 9 

3. Data Collection: Telephone and Field Procedures 10 

3.1 Telephone Interviewing Case Management 12 

3.2 CATI Production 14 

3.3 Refusal Conversion 15 

3.4 Respondent Locating 12 

3.5 Maximum Calls 18 

3.6 Field Operations 20 

3.7 Quality Assurance 21 

3.7.1 Measures of Productivity 21 

3.7.2 Interviewer Monitoring 22 

4. Response Rates 24 

5. Evaluation of Instrument 27 

5.1 Length of Interview 27 

5.2 Non-response by Item 28 

5.3 Reinterviews 31 

6. B&B:93/94 Transcript Component 34 

6.1 Transcript Collection Procedures 34 

6.2 Transcript Processing Procedures 35 

6.3 B&B:93/94 Transcripts Eligibility Criteria 37 

6.4 Quality Control 39 

7. Weights Development Documentation for B&B: 93/94 Sample 40 

7.1 Weights Development Procedure 41 

7.2 Design effects 48 

References 58 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology Report 



List of Tables 

Table 2.1 NPSAS:93 student sample sizes 7 

Table 2.2 B&B cohort NPSAS:93 response rates by institution type 8 

Table 2.3 B&B sample composition 9 

Table 3.1 Average number of calls made in the TMNS to complete a case 15 

Table 3.2 Final completion status by initial refusal status 16 

Table 3.3 Final completion status for locating problem cases 18 

Table 3.4 Final completion status by “maximum call” status 19 

Table 3.5 Total number of interviewing minutes monitored and error rates 23 

Table 4.1 Response rates by mode of interview 25 

Table 4.2 Case disposition by demographic characteristics of sample 26 

Table 5.1 Interview administration time by section 27 

Table 5.2 Item non-response 29 

Table 5.3 Consistency between original interview data and reinterview data: 

education items 32 

Table 5.4 Discrepancies between original interview data and reinterview data: 

employment items 33 

Table 6.1 Completion rate for B&B:93/94 transcript component 35 

Table 6.2 Questionnaire-transcript status interaction 38 

Table 6.3 Transcript and CATI eligibility 39 

Table 7.1 Final distribution 40 

Table 7.2 Final dispositions 41 

Table 7.3 control totals by institution stratum 43 

Table 7.4 Case identifiers corresponding to weights 45 

Table 7.5 Weighted response rates by strata 47 



O 

ERIC 



IV 



6 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology Re£ort 

List of Tables (Continued) 

Table 7.6 Design effects for all respondents 49 

Table 7.7 Design effects for female respondents 50 

Table 7.8 Design effects for male respondents 51 

Table 7.9 Design effects for Black respondents 52 

Table 7.10 Design effects for Asian respondents 53 

Table 7. 1 1 Design effects for Hispanic respondents 54 

Table 7.12 Design effects for White respondents 55 

Table 7.13 Design effects for respondents at 4-year public institution 56 

Table 7.14 Design effects for respondents at 4-year private institution 57 



Baccalaureate and Beyond Longitudinal Study 93/94 

First_ Follow-up Methodology Report 

List of Figures 

Figure 3.1 Paths toward case completion 11 

Figure 3.2 Daily CATI production 13 

Figure 3.3 CATI production rates 14 

Figure 3.4 Field production rates 21 

Figure 6.1 B&B transcripts courses coded 37 



Appendices 

Appendix A: Sample advance letter 
Appendix B: Refusal conversion letters 
Appendix C: NPSAS items 
Appendix D: B&B items 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology Report 



Acknowledgments 

The Baccalaureate and Beyond:93/94 (B&B:93/94) Methodology Report could not be completed 
without the assistance of staff from the National Center for Education Statistics and Office of Educational 
Research and Improvement. Paula R. Knepper, Project Officer and C. Dennis Carroll, Postsecondary 
Longitudinal Studies Program Director, in particular were extremely helpful in the preparation of the 
report and in providing support throughout the data collection. We would also like to thank Robert S. 
Burton and Peter S. Stowe of NCES, and Daniel Goldenberg of the Department’s Planning and 
Evaluation Service for their review of this report and the many insights which they provided. 

The success of the B&B:93/94 survey is largely attributable to the hard work and dedication of 
many staff at NORC. The authors would like to acknowledge the specific contributions of Kathy Salmon 
and Cheryl Gilbert (task leaders for field data collection) and Cathy Haggerty (task leader for phone 
center data collection), whose roles in the data collection led to a well orchestrated and highly successful 
survey. 

The authors would like to thank Norman Bradburn and the members of the technical advisory 
board for their guidance in the development of the survey design and their assistance in developing the 
study instruments. Finally, we extend thanks to the willing participants in the B&B study who devoted 
their time and were forthcoming with the information that is the basis of this report. 





Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology. Report 



1. An Overview of the Baccalaureate and Beyond Study 
1.1 Purpose of the Study 

The Baccalaureate and Beyond Longitudinal Study (B&B:93) tracks the experiences of a cohort 
of recent college graduates, those who received the baccalaureate degree during the 1992-93 academic 
year and were first interviewed as part of the National Postsecondary Student Aid Study (NPSAS). This 
group's experiences in the areas of academic enrollments, degree completions, employment, public 
service, and other adult decisions will be followed for about 12 years. Ultimately, B&B:93 will provide 
data to assess the outcomes of postsecondary education, graduate and professional program access, and 
rates of return on investment in education. 

The U.S. Department of Education's National Center for Education Statistics (NCES) is 
authorized to conduct the B&B:93 study under Section 404(a) of the National Education Statistics Act 
of 1994, Title IV of the Improving America's Schools Act of 1994, P.L. 103-382, which states: 

"The duties of the Center are to collect, analyze, and disseminate statistics and other 
information related to education in the United States and in other nations, including (1 ) 
collecting, acquiring, compiling ..., and disseminating full and complete statistics on the 
condition and progress of education at the pre-school, elementary, secondary, and 
postsecondary levels in the United States, including data on ... 

• student achievement at all levels of education; ... 

• educational access to and opportunity for postsecondary education, including data on 
financial aid to postsecondary students; 

. teaching, including data on course-taking, instruction, the conditions of the education 
workplace, and the supply of, and demand for, teachers, which may include data on the 
proportions of women and men, cross-tabulated by race or ethnicity, teaching in subjects 
in which such individuals have been historically underrepresented; 

• the learning and teaching environment, including data on libraries; 

• the financing and management of education, including data on revenues and 
expenditures; and ... 

(3) conducting longitudinal studies as well as regular and special surveys and data collections, 
necessary to report on the condition and progress of education ; ..." 



1.2 Analytic Objectives 

As the 1 992-93 cohort of college and university graduates advances through adulthood, the effects 
of postsecondary education will become increasingly important. The B&B:93 study will provide data to 
address issues in several major areas of educational policy: educational attainment; access to graduate 
and professional schools; the rate of return on educational investment; and patterns of preparation and 
engagement in teaching. 

Attainment and outcome assessment. Degree completion, licensing, and certification are 
central to educational attainment and outcome assessment. Questions in this area include the following. 
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• Are bachelor’s degree recipients able to enter the work force or graduate school soon after 
acquiring the degree or within the time periods they expect? 

• Do bachelor’s degree recipients enter jobs related to their major fields of undergraduate 
study? 

• How long do bachelor’s degree recipients take to complete the bachelor’s degree? Does 
this vary by field of study, type of school, age of student, or time of first entry into a 
postsecondary program? 

• How long does it take to obtain a job in an area related to the field of study? Does the 
required time differ by degree attained? Does it differ by field? 

Graduate and professional program access. Entrance into graduate or professional school after 
completing the bachelor's degree raises many of the same questions as initial entry into the work force. 
In many fields, it is necessary to complete a graduate program to get a job in the field. In other fields, 
such as teaching, additional study may be required to continue working or to be promoted in the field, 
even though graduate education is not required for initial entry into the field. In most fields, graduate 
education enhances the ability to perform, even if it is not strictly required for entrance, continuation, or 
promotion. Therefore, it is important to determine whether persons who wish to continue their education 
beyond the baccalaureate degree have the opportunity to do so. Questions in this area include the 
following: 

• Are people who want to enter graduate school immediately after completing the 
bachelor's degree able to do so? Why do some graduates delay entry into graduate or 
professional study? Do these persons persist in seeking to enter and do they succeed in 
entering later? 

• Are those who want to enter graduate school after gaining some work experience able to 
do so when they planned, or are they further delayed? Do they carry out their original 
plan or later decide against graduate school? How long do they delay entry? 

• What proportion of students who have no plans for graduate school at the time they 
complete the bachelor’s degree later change their minds and attempt to enter graduate 
school? Do these persons have the access they would have had if they had attempted to 
enter graduate school immediately after completing the bachelor’s degree? Are there 
additional difficulties associated with later decisions to enter graduate school? 

Rate of return. Rate of return refers to the financial payoff or other value of the bachelor's 
degree relative to the expense in time and money of obtaining the degree. There are two perspectives for 
gauging the rate of return. From the perspective of the individual, the rate of return can be measured in 
terms of monetary reward and personal satisfaction. From the perspective of society, rate of return can 
be measured in terms of the contribution a student makes to the nation’s productivity as well as through 
community involvement and public service. For example, societal returns to investments in 
postsecondary education include the work performed by bachelor's degree recipients in public service 
areas such as teaching, volunteer work, and other community service. 
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For both the individual and society, rate of return can also be gauged by the adequacy of the 
individual's preparation for entry into work and community service and by the individual s acquired ability 
to gain from and contribute to that experience. B&B:93 examines the rates of return from postsecondary 
education from the perspectives of both the individual and society. Specific questions include the 
following: 

• What proportion of bachelor's degree recipients enter jobs related to their fields of study 
immediately after receiving the bachelor's degree? Are these persons able to work 
effectively and advance in their work without additional schooling or do they encounter 
obstacles which can only be overcome by seeking additional education? 

• Do persons who complete graduate school have a better chance to obtain positions in 
their field than persons who do not complete graduate school? Is there a difference in 
starting salaries between those who have completed graduate school and those who have 
not? Is there a long term difference in salary? 

• How many bachelor's degree recipients are eligible or qualified to enter public service 
professions such as teaching? How many enter full-time positions in public service fields 
for which they are qualified? 

• Is the proportion of persons who enter public service fields higher or lower among 
persons seeking jobs immediately after completing the B.A. than among those who first 
attend graduate school? 

• Do bachelor's degree recipients who enter public service positions advance in their jobs 
at the same rate as bachelor's degree recipients who enter non-public service jobs? 

Patterns of teaching. Another important feature of the B&B:93 program is that the sample has 
been designed to facilitate the study of elementary and secondary school teaching careers. Data from 
B&B:93 will be used in the monitoring of supply and demand characteristics of the labor market, and 
career patterns of teachers, including movements into and away from this profession over time. Many 
of the same issues discussed earlier, concerning initial aspirations and expectations versus ultimate 
decisions, will be examined. Additional considerations include measuring quality, noting comparative 
values, and measuring monetary returns to teaching. Specific questions that the B&B:93 program will 
help address include: 

• What is the proportion of new college graduates who enter the teaching profession as 
their first career versus those who are attracted to it later in life? What are the defining 
characteristics of these groups? 

• What is the rate at which teachers change careers, and how does it compare to career- 
changing patterns of other professionals? How satisfied are teachers in their careers 
versus those who are employed in other occupations? 

• What are the potential sources for new teachers, that is, where do those who enter 
teaching come from (and, of those who left it, where did they go)? 

• How do teachers compare with non-teachers along the lines of gender, race-ethnicity, and 
socioeconomic backgrounds? 
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In summary, B&B:93 will contribute to a comprehensive statistical investigation of educational 
policy issues and help to fulfill NCES’s mission, to report on the condition and progress of American 
education in all its aspects. In recognition of its broad mandate, NCES has expanded its data collection 
program to investigate educational experiences beyond the traditional span of postsecondary education. 
Baccalaureate and Beyond, with its wealth of data on the consequences of postsecondary education, will 
contribute to the study of education as a lifelong process. 



1.3 Study Design 



The B&B:93/94 study is the first in a series of five follow-up interviews of persons who received 
a bachelor's degree in the 1992-1993 academic year. Baseline data for the B&B:93 cohort were collected 
as part of the National Postsecondary Student Aid Study (NPSAS:93). The first follow-up interview 
(B&B:93/94) collected information from respondents one year after they received their bachelor's degree. 
Subsequent interviews will take place at three year intervals. By the end of the 12-year period, most 
students who attend graduate or professional schools should have completed, or nearly completed, their 
education and be established in their careers. 

Data collection for the first follow-up of Baccalaureate and Beyond took place in the summer and 
fall of 1994. The B&B:93 cohort comprised approximately 12,500 individuals who were determined, 
in NPSAS, to be potentially eligible for follow-up in 1994. Respondents were interviewed using 
Computer- Assisted-Telephone-Interviewing (CATI), as well as field interviewing when necessary. In 
addition, undergraduate transcripts from the respondents' degree-granting institutions were collected as 
part of the first follow-up study. Data collection activities took place as follows: 

B&B:93/94 CATI data collection June 15, 1994 - October 8, 1994 

B&B:93/94 Field data collection August 20, 1994 - December 31, 1994 

B&B:93/94 Transcript data collection August 15, 1994 - December 31, 1994 
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The B&B:93 sample design represents all postsecondary students in the United States who 
completed a bachelor's degree in the academic year 1992-93 (AY 93). The B&B:93/94 sample was a 
subsample of the students selected for the 1993 National Postsecondary Student Aid Study sample, a 
nationally representative sample of all postsecondary students. The B&B:93/94 sample of baccalaureate 
degree graduates includes those students in the NPSAS:93 sample who were identified by the institution 
or during the student interview as potentially eligible for B&B:93/94. Cases were identified as potentially 
eligible for B&B:93/94 if there was information indicating that the respondent had received, or expected 
to receive a baccalaureate degree between July 1, 1992 and June 30, 1993. All NPSAS:93 sample 
persons who satisfied the subsample requirements were designated as potential eligibles for B&B:93/94 
irrespective of whether these persons were respondents or nonrespondents in NPSAS:93. 



2.1 Original NPSAS:93 Sample Design 

The NPSAS:93 survey employed a stratified multi-stage sample design with postsecondary 
institutions as the first-stage unit and students within schools as the second-stage unit. The institution 
sample was stratified by type of control (private vs. public), highest degree offered, size of enrollment 
in professional programs, graduate student enrollment, and the number of bachelor's degrees awarded in 
education. The target population for NPSAS:93 contained nearly all postsecondary institutions in the 50 
states, the District of Columbia, and Puerto Rico. To be eligible for inclusion in the sample, an institution 
was required to satisfy all of the following conditions: 



Offer an education program designed for persons who have completed secondary 
education; 

Offer an academic, occupational, or vocational program of study; 

Offer access to persons other than those employed by the institution; 

Offer more than just correspondence courses; 

Offer at least one program requiring at least three months or 300 clock hours of 
instruction; and 

Be located in the 50 States, the District of Columbia, or Puerto Rico. 



An institution was not eligible for inclusion in NPSAS if it served only secondary students, if it 
provided only avocational, recreational, or remedial courses, if it offered only in-house business courses, 
if it offered only seminars of less than three months duration (such as driver training schools, real estate 
courses, and tax preparation classes), or if it offered only correspondence courses. United States Service 
Academies were not eligible for NPSAS because of their unique funding base, and hence were not part 
of the B&B:93/94 sample. 

A total of 1,386 postsecondary institutions were sampled for NPSAS:93; 143 were deemed 
ineligible based on the criteria outlined above. Of the 1,243 eligible institutions, 88 percent participated 
by submitting lists of students for selection into the NPSAS:93 sample. 

Within participating institutions, students eligible for selection into the sample were those who 
were enrolled, or were receiving a baccalaureate degree during the 1992-93 academic year. To be eligible 
for NPSAS:93 students were required to meet the following conditions: 
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(1) Attend a sampled institution between July 1, 1992 and June 30, 1993; and 

(2) Be enrolled in one or more of the following: 

• Course(s) for credit toward a degree or formal award; or 

• Degree or formal award program of at least three months duration; or 

• Occupational or vocational program of at least three months duration. 

Students who took courses only for remedial or avocational purposes and did not receive credit, who only 
audited courses, or who took courses strictly for pleasure rather than as a part of an academic, 
occupational, or vocational program or course of study were not eligible for NPSAS. Furthermore, 
students enrolled in high school or solely in a GED program were ineligible for NPSAS:93, even if they 
satisfied the above conditions. A total of 82,016 students were selected for the NPSAS:93 sample, with 
a final eligible sample size of 79,269. 

In addition, NPSAS:93 included all students who received a baccalaureate degree between July 
1, 1992 and June 30, 1993. (Students who had completed degree requirements prior to July 1, 1992 but 
were awarded a degree after that date were also eligible.) Table 2.1 provides the NPSAS:93 student 
sample sizes by type and institutional sampling stratum. The baseline cohort for the B&B study is 
represented by the “Baccalaureate” column of the table. 



2.2 B&B Student Sample 

In order to provide a base year sample for B&B:93/94, NCES introduced several design 
modifications in NPSAS:93. First, the number of sample institutions offering only four-year 
undergraduate programs or programs of less than four years was reduced relative to the number of sample 
institutions offering post-graduate programs. Second, the number of sample students in four-year 
institutions was increased by 20 percent. Finally, the sample sizes of graduate students and professional 
students were slightly reduced. These three changes in the NPSAS sample design reflect the goal of 
following a large sample of bachelor's degree recipients through post-bachelor's degree experiences. 

Based on these changes in the NPSAS:93 sample design, approximately 16,300 potential 
baccalaureate degree recipients were identified. These students were identified using institutionally 
provided lists of students who filed for graduation in the 1992-93 academic year. Table 2.2 shows the 
NPSAS response rates for the B&B cohort. 




6 



15 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology Report 



Table 2.1 ,~NPSAS:93 student sample sizes 2 



Baccalaureate 



Institutional Stratum 


Business 


Other 


Other 

under- 

graduates 


Grad. 

students 


First 

prof. 

students 


Total 


Total 


1,419 


15,566 


50,501 


9,084 


5,446 


82,016 


1 . Public, 4-yr, first-prof, high ed 1 


53 


647 


1,130 


338 


133 


2,301 


2. Public, 4-yr, first-prof, low ed 


251 


3,741 


5,852 


2,341 


2,191 


14,376 


3, Private, 4-yr, first-prof, high ed 2 


115 


1,186 


1,765 


920 


1,170 


5,156 


4. Private, 4-yr, first-prof, low ed 


28 


558 


481 


446 


1,879 


3,392 


5 Public, 4-yr, doctoral, high ed 1 


56 


557 


947 


328 


2 


1,890 


6, Public, 4-yr, doctoral, low ed 


106 


1,435 


2,556 


978 


0 


5,075 


7, Private, 4-yr, doctoral, high ed 2 


33 


240 


331 


411 


1 


1,1016 


8. Private, 4-yr, doctoral, low ed 


5 


234 


217 


243 


0 


699 


9, Public, 4-yr, masters, high ed 3 


35 


476 


1,221 


298 


4 


2,034 


10. Public, 4-yr, masters, low ed 


289 


2,755 


6,296 


1,724 


0 


1 1 ,064 


1 1 . Private, 4-yr, masters, high ed 3 


23 


208 


343 


137 


0 


711 


12. Private, 4-yr, masters, low ed 


201 


1,683 


2,906 


903 


66 


5,759 


13. Public, 4-yr, bachelors, high ed 3 


21 


151 


461 


2 


0 


635 


14. Public, 4-yr, bachelors, low ed 


28 


160 


943 


7 


0 


1,138 


15. Private, 4-yr, bachelors, high ed 3 


16 


176 


388 


0 


0 


580 


16. Private, 4-yr, bachelors, low ed 


159 


1,346 


2,124 


7 


0 


3,636 


17. Public, 2-yr 


0 


l 4 


9,542 


0 


0 


9,543 


18. Private, not-for-profit, 2-yr 


0 


0 


838 


0 


0 


838 


19. Private, for-profit, 2-yr 


0 


0 


1,481 


0 


0 


1,481 


20. Public, less-than-2-yr 


0 


0 


2,055 


0 


0 


2,055 


21. Private, not-for-profit, less-than-2- 


0 


0 


1,351 


0 


0 


1,351 


yr 

22. Private, for-profit, less-than-2-yr 


0 


12 5 


7,273 


l e 


0 


7,286 



1 More than 15 percent of baccalaureate degrees awarded in education. 

2 Any baccalaureate degrees awarded in education. 

1 More than 25 percent of baccalaureate degrees awarded in education. 

4 One institution sampled as a 2-year institution (based on the IPEDS IC file) was determined to be a 4-year institution. 
It is classified as such in all NPSAS:93 analysis tables. 

5 One institution sampled as a less-than-2-year institution (based on the IPEDS IC file) was determined to be a 4-year 
institution. It is classified as such in all NPSAS:93 analysis tables. 



SOURCE: NCES, Baccalaureate and Beyond:93/94 



2 Methodology Report for the National Postsecondary Student Aid Study, 1992-93 (Loft, Riccobono, 

Whitmore, Fitzgerald, Berkner, Malizio, NCES 95-211). 




7 

r 



16 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology Report 



Table 2.2.— B&B cohort NPSAS:93 


response rates by institution type 






Type of student 


Eligible 

sample 

students 


Participating 

students 


Response rate 


All students 


16,316 


11,810 


72.4 


Institutional level: 


Bachelors or less 


1,967 


1,372 


69.8 


Masters 


5,433 


4,055 


74.6 


Doctors 


2,539 


1,762 


69.4 


First-professional 


6,377 


4,621 


72.5 


Institutional control: 


Public 


10,410 


7,714 


74.1 


Private, not-for-profit 


5,723 


3,968 


69.3 


Private, for-profit 


183 


128 


69.9 


Institutional sector: 


Public, bachelors or less 


408 


326 


79.9 


Public, masters 


3,380 


2,568 


76.0 


Public, doctors 


2,029 


1,454 


71.7 


Public, first-professional 


4,593 


3,366 


73.3 


Private, not-for-profit, bachelors or less 1,447 


967 


66.8 


Private, not-for-profit, masters 


1,983 


1,439 


72.6 


Private, not-for-profit, doctors or first- 


professional 


2,293 


1,562 


68.1 


Private, for-profit 


183 


128 


69.9 



SOURCE: NCES, Baccalaureate and Beyond:93/94 



All B&B eligible sample members who completed the NPSAS interview were retained for future 
follow-up. Of the 1 1,810 cases which were considered NPSAS completes, 1 1,254 were delivered with 
the first wave of data (designated as sample type 1 in table 2.3). The remaining 556 were identified later 
and were delivered as part of sample type 4. A subsample of approximately ten percent of the remaining 
eligible cases with at least some data (either partial CATI, Computer Assisted Data Entry (CADE) data 
from the institution, or parent data) were also identified and delivered as sample types 2 and 3. 
Additional sample members (who were not part of the NPSAS B&B cohort) were identified as AY92-93 
bachelor’s degree recipients upon review of the completed NPSAS interview. Altogether, four different 
types of sample members constituted the B&B:93 cohort, as shown in table 2.3. 
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Table 2.3.--B&B sample composition 



Original NPSAS B&B cases: 


Initial sample 


Final sample 


1 . Student respondents 


11,254 


11,254 


2. Student nonrespondents with parent data 


372 


300 


3. Subsample of other student nonrespondents 


230 


164 


Additional B&B cases identified during data processing: 






4. NPSAS student respondents identified as 
potentially eligible for B&B 


875 


760 


Total 


12,731 


12,478 



SOURCE: NCES, Baccalaureate and Beyond:93/94 and National Postsecondary Student Aid Study, 1993. 

During the data collection period it became clear that many of the NPSAS nonrespondents and 
the cases identified late as potential B&B respondents (sample types 2, 3, and 4 in Table 2.3) were not, 
in fact, eligible for B&B. Because of the costs involved in contacting ineligible respondents, it was 
desirable to select only a subsample of these cases to be included in the final B&B sample. The 
subsample was selected from the group of nonrespondents in the sample who did not complete a full 
B&B interview in NPSAS:93 (sample types 2,3, and 4 in Table 2.3). All students who were respondents 
in NPSAS (sample type 1) were included in the final B&B sample. 

The subsample selection was carried out by constructing a file of all B&B eligible nonrespondents 
in sample types 2, 3, and 4 as of November 1, 1994. Complete cases, cases with pending interviewer 
appointments, sample members determined ineligible, and cases finalized as non-interviews (primarily 
hostile refusal cases) were excluded from the subsampling file. This file was then sorted by institution 
stratum, student stratum, and student sample type in order to affect stratification in the selection process. 
A systematic sample of 200 persons, from approximately 450 in the file, were selected. The subsampling 
process decreased the B&B sample size to 12,478, as shown in Table 2.3 above. 



2.3 B&B:93 Sample Eligibility 

During data collection, for both the interview and transcript components, it was discovered that 
many of the respondents who had been designated by NPSAS as B&B sample members were not eligible 
to be included in the sample. Sample eligibility was determined in two ways: first, by confirming with 
respondents the date they received their baccalaureate degrees, and second, by examining the transcripts 
received from baccalaureate institutions. The final B&B:93 sample includes respondents identified as 
eligible in either portion of the study, as described in subsequent sections of this report. The sample 
which will be followed for future rounds and cross-component eligibility is discussed in the chapter 
describing the transcript component (see Table 6.3). 
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3. Data Collection: Telephone and Field Procedures 

Overview. An initial mailing containing a letter and informational leaflet was sent to all 12,731 
B&B:93/94 sample members in the summer of 1994 - Wave 1 cases in June, and Wave 2 cases in July - 
inviting them to participate in the study. 1 The letter, included in Appendix A, provided a summary of the 
survey objectives, an introduction to NCES and NORC, and a promise of strict adherence to the privacy 
protection laws. The letter also provided a toll-free 800 number for sample members to obtain further 
information or to schedule an interview. 

Telephone interviewing began approximately one week after the advance letter mailing. 
Interviewing commenced on June 15, 1994 for Wave 1, and August 5, 1994 for Wave 2. Telephone 
interviewing continued until October 8, 1994, a period of 16 weeks. Cases that were pending at the end 
of this time were sent to field interviewers and worked from October 8 through December 31, 1994, a 
field period of 12 weeks. 2 

Figure 3.1 summarizes the flow of cases through the major activities in the B&B:93/94 survey. 
As shown, case records for the sample were loaded into the CATI Telephone Number Management 
System (TNMS) and delivered to interviewers. Cases were delivered primarily during peak contacting 
periods which included Monday through Thursday evenings, Saturday morning and afternoon, and 
afternoon and evening hours on Sunday. A total of 7,456 cases (68 percent of 10,958 eligible cases) were 
completed in-house. An analysis of the case delivery management is presented in section 3.1; CATI 
production is described in section 3.2. 

Respondents refusing to participate in the B&B:93/94 study presented a significant problem 
during data collection. A full 20 percent of the eligible sample refused to participate at some time during 
the interviewing effort. CATI refusal conversion specialists contacted these respondents in an effort to 
persuade them to participate. Respondents who continued to refuse participation were contacted by field 
interviewers for in-person follow-up. Section 3.3 presents an analysis of the problem and describes the 
refusal conversion process. 



1 Due to the different types of sample members in the B&B:93 student sample (see section 2.3), treatment of 
these cases occurred in two waves. Wave 1 cases, corresponding to student sample types 1 and 2, totaled 1 1,626 sample 
members; sample types 3 and 4 constituted the 1,105 sample members in Wave 2. 

2 In actuality, field work began on a small number of cases in August, when telephone center supervisors began 
transferring hard refusal and unbeatable cases to the field, once all telephone efforts had been exhausted. The total 
number of cases completed from August 20 to October 8, when telephone activities were halted, accounts for about five 
percent of all 10,080 cases completed. 
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Cases were identified as locating problems during the first few weeks of production and set aside 
for specialist locators. Although approximately 34 percent of eligible cases were at some time 
unbeatable, the completion rate for this group was quite high — 88 percent vs. 74 percent for the refusal 
group. More information about the locating effort is presented in Section 3.4. 

After telephone interviewing was halted in early October, field interviewers were sent all 
remaining pending cases: 3,698 cases or about 30 percent of the net sample. Overall, the field staff 
completed 2,624 cases increasing the final response rate for B&B:93/94 to 92 percent. Field activities 
are described in Section 3.6. 

3.1 Telephone Interviewing Case Management 

The CATI Telephone Number Management System (TNMS) is NORC's standard call scheduling 
and telephone number delivery system. The system is responsible for routing cases to interviewers at the 
most opportune times for telephone contact. Interviewers record call-outcomes for each case in the 
TNMS and the system chooses the next appropriate action depending on the last outcome, and history 
of outcomes, for the case. 

The TNMS tracked the status of cases in B&B:93/94 using a location flag attached to each case. 
The case delivery module of the system delivered cases which were in the general interviewing location. 
Cases in all other locations (such as refusals or locating problems) were accessed directly and managed 
by the appropriate staff group. The location flag was automatically updated by the system depending on 
the outcome code provided by the interviewer. The TNMS used in B&B:93/94 contained six different 
locations: 



1. General interviewing 

2. Initial refusal 

3 . Locati n g prob 1 em 

4. In the locating module 

5. In the field 

6. Refusal conversion active 

Respondents who refused to complete the interview were coded as refusals by the interviewer and 
automatically routed to location two. A letter was sent to each respondent which attempted to address 
their specific concerns and, after a short cooling-down period, the case was routed to location six to be 
accessed and worked by a refusal convertor. (See Appendix B for a copy of the refusal conversion 
letters.) If the respondent could not be converted, the case was filed to location five and sent to the field. 
When a case was identified as a locating problem, it was filed to location three. Each night the system 
automatically scanned new cases put into location three and loaded them into the Case Management 
System (CMS) locating database. The cases moved to the CMS were then moved to location four in the 
TNMS and remained there until the locating information had been updated and the case could be 
activated for interviewing in the TNMS. 

Calling algorithms. The calling times and case routing schedule set up for the B&B:93/94 
sample assumed that the best times to reach B&B:93/94 sample members were Monday through Thursday 
evening and on Saturday and Sunday. The telephone center was in operation from 8:00 a.m. - 1 1:00 p.m. 
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on Monday through Friday, 8:00 a.m. - 6:00 p.m. on Saturday, and 11:00 a.m. -11:00 p.m. on Sunday. 



Cases were delivered to interviewers by the TNMS eight times over a two-week period, or four 
times each week, before being filed to a queue for supervisor review. The calling algorithm for the week 
had a built-in preference for Saturday and Sunday; cases were delivered twice during the weekday 
evenings, once on Saturday, and once on Sunday. This pattern was repeated the second week and, if no 
contact had been made with the respondent, the case was reviewed by a supervisor and either sent to 
locating or sent back to the floor to be called during an off-cycle period. 

The calling delivery cycle was stopped as soon as an appointment was set to call the respondent. 
From that point forward, appointments were determined when the respondent was called. 

Figure 3.2 presents data on case completion by day of the week. Although the number of 
completed cases does not vary significantly in the remainder of the week, the graph does show that 
Sundays were not particularly effective days to call respondents. In fact, during the summer months, 
respondents were more likely to complete an interview on weekday evenings than on a weekend day. 

Figure 3.2.-Daily CATI production 



Completes per interviewer by day of week 




Project staff expected that many respondents would try to delay the interview because of their 
busy lifestyle. B&B:93/94 interviewers attempted to complete the interview when the respondent was 
contacted and attempted not to let the respondent delay the interview. However, appointments were very 
common and B&B interviewers tried to accommodate all requests for appointments made by respondents. 
To ensure that interviewers were available to keep scheduled appointments and not involved in other 
calls, cases that had requested appointments were delivered to telephone interviewers 20 minutes early. 
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3.2 CATI Production 

Data collection began on June 15, 1994. Week-by-week production and cumulative completes 
are diagrammed in figure 3. 3. 3 The graph shows that the first two weeks of data collection were the most 
successful, with the first week (actually, ten days) of production being the highest. Production for the 
majority of the following weeks averaged about 600 cases per week. Finally, in the last third of the data 
collection period, production decreased to about 200 cases per week, as the last and hardest cases were 
handled and more cases were sent to the field. 



Figure 3.3.— CATI production rates 




Weekly Cumulative 

NOTE: Figures include out-of-scope and ineligible cases. 

SOURCE: NCES, Baccalaureate and Beyond:93/94 




The number of calls per completed case is the best estimate of the level of effort required in the 
interviewing task. The TNMS tracks every call, writing to a log file the outcome of the call and the date 
and time of the attempt. Estimates of the level of effort necessary to complete a telephone interview can 
be estimated from the data in the log file. The number of calls required to complete cases for the 
B&B:93/94 sample is presented in Table 3.1. These data are consistent with level of effort estimates for 
the B&B:93/94 sample and actual experience with similar samples. 



3 Out-of-scope and ineligible cases were also counted as completes during data collection. The telephone 
shop completed interviews with 7456 cases and determined 1094 cases to be ineligible/out-of-scope. 
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Table 3.1 .—Average number of calls made in the TNMS to complete a case 







Average number of 


Standard deviation 


Sample: 


Number of cases 


calls in the TNMS 


around the mean 


Completed cases * 


8,563 


13.4 


2.5 


All eligible cases 


10,958 


10.5 





* Completed by phone shop, including identification of ineligibles. 
SOURCE: NCES, Baccalaureate and Beyond;93/94 



3.3 Refusal Conversion 

A total of 2,175 respondents (19.8 percent of the total eligible sample) refused to complete the 
interview at some point in the interviewing process, a refusal rate about twice as high as originally 
expected. Early in the data collection period, a supervisor reviewed the call notes for each refusal in order 
to better understand the reasons respondents chose not to participate, and to tailor the approach to 
converting refusals. The supervisor found that the cases fell into several major categories, and generally 
followed the same distribution as for the field test. The review showed that previous experience with the 
NPSAS:93 survey was still a significant factor in whether or not a sample member chose to participate. 
Indeed, many sample members who refused either confused the B&B:93/94 study with NPSAS:93, or 
refused to participate based on their prior experience. Other major refusal reasons were typical of most 
surveys: no time or too busy; not interested in participating, interview length too long; or confidentiality 
issues. 



A three-stage process to convert sample members who refused to participate was planned and 
executed. All cases were sent a letter addressing the specific reason the respondent refused. Samples 
of these letters are included in Appendix B. The letters were followed up by a phone call from a refusal 
converter at the central CATI site. Only one attempt was made by the phone center to convert refusals; 
continuing refusals were forwarded to the field to be contacted in person by a field interviewer. 

Refusal conversion calls began about four weeks after the start of data collection. Several 
B&B:93/94 trained interviewers were selected to convert refusal cases. The interviewers were chosen 
for their calm and assertive style of interacting with respondents. The interviewers attended a briefing 
that included a review of the types of refusals and a general practice of gaining cooperation. The CATI 
refusal converters were able to convert and complete 25 percent of the refusal cases; another 49 percent 
were converted by field interviewers. In all, NORC interviewers were able to successfully complete 
interviews with 1,61 1 (74.1 percent) of the 2,175 initial refusals. Table 3.2 demonstrates the refusal 
problem and the overall conversion success rate. 
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Table 3.2.— Final completion status by initial refusal status 





Complete 


Final 


Unlocated 


Other Non- 
response 


Subtotal 


Ever refused 


Phone 


25.0% 


7.5% 


0.0% 


0.2% 


32.7% 




543 


164 


0 


4 


711 


Field 


49.1% 


15.0% 


1.5% 


1.7% 


67.3% 




1068 


327 


33 


36 


1464 


Subtotal 


74.1% 


22.6% 


1.5% 


1.8 


100% 




1611 


491 


33 


40 


2175 


Never refused: 


Phone 


78.7% 


0.3% 


0.0% 


0.4% 


79.4% 




6913 


27 


0 


35 


6975 


Field 


17.7% 


1.4% 


0.7% 


0.8% 


20.6% 




1556 


121 


62 


69 


1808 


Subtotal 


96.4% 


1.7% 


0.7% 


0.8% 


20.6% 




8469 


148 


62 


69 


1808 


Total 


10080 


639 


95 


144 


10958 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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3.4 Respondent Locating 

Cases were loaded into the TNMS with the "best" telephone number for reaching the respondent 
based on the prefield locating information. Interviewers were trained to follow all leads provided by this 
telephone number and to update the number when new information was discovered. However, if the 
interviewers were unable to locate a respondent, the case was moved to the Case Management System 
(CMS) for further locating attempts. 

Prior to the start of data collection, B&B:93/94 staff identified the most effective locating 
resources for finding B&B:93/94 respondents. Those resources are listed below in the order in which 
they were used: 



• Last known telephone number of the parent(s) 

• Last known telephone number of a contact person 

• Other NPSAS obtained locating leads (when available) 

• Credit database (TRW and Equifax) 

• Bachelor degree school alumni office 

The B&B:93/94 main study employed a locating strategy which was used successfully in the field 
test. Central office telephone locators were teamed with locators in the field to expeditiously work cases 
which were not previously located. Matching the expertise of the central office locators with the regional 
knowledge of the field locators was expected to result in a more thoughtful, thorough, and cost efficient 
way to find respondents. 

A locating supervisor coordinated the locating effort between the telephone and field locators for 
each team. Each week the supervisor reviewed the cases assigned to each of the teams, making 
suggestions for additional work or concurring with the nomination of the case for field work. Some cases 
remained unbeatable at the close of telephone operations; these were turned over to and worked by the 
field interviewers. 

Using this strategy, central office locators were able to find and complete 47 percent of the 3717 
locating problem cases. The field locators were slightly less successful, completing 41 percent of the 
unbeatable cases. (The bulk of locating problem cases were the more difficult to work and probably held 
hidden refusals, as evidenced by the higher final refusal status in the field.) Table 3.3 shows a breakdown 
of the locating problem cases and the level of effort expended in the CMS. Of the 3,717 cases with 
locating problems, 3,264 (87.8%) were successfully traced and interviewed. 
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Table 3.3.— Final completion status by locating problem cases 





Complete 


Final 
- refusal 


Unlocated 


Other Non- 
response 


Subtotal 


Locating 












needed: 












Phone 


46.9% 


1.3% 


0.0% 


0.6% 


48.8% 




1744 


49 


0 


22 


1815 


Field 


40.9% 


6.5% 


1.9% 


1.9% 


51.2% 




1520 


242 


69 


69 


1902 


Subtotal 


87.8% 


7.8% 


1.9% 


1.8 


100% 




3264 


291 


69 


40 


3717 


Locating 












unnecessary: 












Phone 


78.9% 


2.0% 


0.0% 


0.2% 


81.1% 




5712 


142 


0 


17 


5871 


Field 


15.2% 


2.8% 


0.4% 


0.5% 


18.9% 




1104 


206 


26 


34 


1370 


Subtotal 


94.1% 


4.8% 


0.4% 


0.7% 


100% 




6816 


348 


26 


51 


7241 


Total 


10080 


639 


95 


144 


10958 



SOURCE: NCES, Baccalaureate and Beyond:93/94 



3.5 Maximum Calls 

Another problem identified and tracked during data collection was the number of times a sample 
member was contacted by the telephone center. The limit of “maximum calls” was set at 14 contact 
attempts. A “call” was counted each time there was some contact with the respondent’s household; this 
could be a contact with the respondent, a contact with someone else in the house, or an answering 
machine. Using these parameters, a total of 2,687 cases fell into the maximum calls problem category. 

It was initially thought that these cases were actually hidden refusals and that the sample members 
were implicitly refusing to participate by avoiding any contact attempts. However, as table 3.4 shows, 
the completion rate for this group was almost as high as that for the entire sample. It is apparent that this 
type of problem case was better handled by the field interviewers; 57 percent of the maximum call cases 
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were interviewed by the field staff versus 33 percent completed by the telephone center. It would seem 
that a personal contact may have been necessary to gain cooperation from reluctant sample members. 



Table 3.4.-Final completion status by “maximum call” status 





Complete 


Final refusal 


Unlocated 


Other Non- 
response 


Subtotal 


14 or more 
calls made: 












Phone 


32.8% 


0.9% 


0.0% 


0.1% 


33.8% 




880 


25 


0 


3 


908 


Field 


57.3% 


6.7% 


0.8% 


1.5% 


66.2% 




1540 


179 


21 


39 


1779 


Subtotal 


90.1% 


22.6% 


1.5% 


1.6% 


100% 




2420 


491 


33 


42 


2687 


Fewer than 14 
calls made: 












Phone 


79.5% 


2.0% 


0.0% 


0.4% 


81.9% 




6576 


166 


0 


36 


6778 


Field 


13.1% 


3.3% 


0.9% 


0.8% 


18.1% 




1084 


269 


74 


66 


1493 


Subtotal 


92.6% 


5.3% 


0.9% 


1.2% 


100% 




7660 


435 


74. 


102 


8271 


Total 


10080 


639 


95 


144 


10958 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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3.6 Field Operations 

In early October, the telephone center ceased work on B&B:93/94 and all pending cases were 
transferred to NORC's field staff. All were cases the telephone center had been unable to complete 
because the respondent refused, was evasive, or had not yet been located. (Field staff actually began 
working a small number of cases in late August, as the telephone center began filtering hard refusal cases 
to the field.) 

Field manager and interviewer recruiting. Seven field managers (FMs) were hired to supervise 
field interviewers (FIs). These FMs were the same FMs hired and trained to work on the field test. The 
field was set-up to use a team management approach. There were three teams each with two FMs; each 
manager was responsible for a specific geographic region of the United States. Field interviewers were 
recruited and hired as needed contingent upon the location of cases. A total of 150 FIs were hired for 
B&B:93/94. 

Field manager training. The seven field managers received five hours of self-study and two- 
hour telephone training calls. The main focus of training for the FMs was how to use the CMS. (FMs 
used the CMS for reviewing cases nominated for field work as well as for entry of cost and production 
information). A Field Manager's manual was developed which described the role and expectations of the 
FMs as well as administrative specifications. The self-study time was largely devoted to review of all field 
interviewer materials, the FM manual and hands-on practice with the CMS. The telephone training calls 
were geared towards teaching the FMs the skills needed to adequately use the CMS, reviewing 
administrative procedures and answering questions. 

Field interviewer training. The training program for field interviewers included three hours of 
self-study and a brief telephone review with their field manager. A self-study manual was developed 
which described the study, task-specific procedures, and the role and expectations of the field staff. A 
self-study exercise, designed for interviewers to assess their own knowledge of the information, was also 
enclosed with their manual. Once interviewers had carefully read through their manual and completed 
the self-study exercise, a telephone review was scheduled with their FM. The field managers reviewed 
procedures, answered questions, and assessed the interviewer's understanding of the procedures. 

Field production. A total of 3,698 cases (29.6 percent of the total sample) were sent to the field. 
The cases sent to the field were the most difficult: 40 percent were refusals, and 60 percent were cases 
that had been contacted 14 times without completion or were cases that had not been located. 

When the telephone center nominated a case for completion by the field, the case was reviewed 
by a team of telephone and field supervisors who discussed whether further efforts in the telephone center 
would be fruitful. If the case was sent to the field, a telephone center supervisor assigned the case to one 
of the three field teams based on the geographic location of the case, or if unknown the original address 
NORC had for the respondent at the start of data collection. Case materials were sent to the field 
manager, including a face sheet with locating and demographic information, a call history report with 
notes made by telephone shop interviewers and locators describing each contact made with the 
respondent/contact/locating resource, and a resource listing with all of the locating resources used and/or 
available for the case. The cases were then reviewed by the FMs before being assigned to a field 
interviewer. Hardcopy materials were used in two ways: by the FM for making case assignment 
decisions, and as a reference for the field interviewer assigned to work the case. 



20 




30 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology Rejjort 



Figure 3.4 shows the weekly and cumulative production rates for the field data collection. 4 The 
field staff completed 3,050 (82.4 percent) of the total case workload, bringing the final B&B:93/94 
response rate to 92 percent. As compared to CATI production rates, the field exhibited a slow initial 
completion rate (because of the small number of cases being worked), and then a steady weekly 
production of about 200 cases. 



Figure 3.4.— Field production rates 




SOURCE: NCES, Baccalaureate and Beyond:93/94 



3.7 Quality Assurance 

Extensive quality control procedures were instituted for the following data collection activities: 
interviewing, locating, and refusal conversion. These procedures are detailed below. 

3.7.1 Measures of Productivity 

Daily automated production reports, which contained statistics on the number of cases completed 
and/or located and the inputs required to attain completion (e.g., effort, labor, and time) were used to 
measure and monitor CATI productivity. These data allowed the B&B staff to pinpoint productivity 
problems with both the interviewing and locating efforts, and to correct for any problems demanding 
attention. 

3.7.2 Interviewer Monitoring 

In addition to monitoring system performance, the data collection staff are subject to quality 
monitoring. This check-and-balance process enables the supervisory staff to evaluate the extent to which 
data quality remains within statistical control, and to identify potential difficulties arising from interviewer 



4 These numbers include 426 out-of-scope and ineligible cases, in addition to the 2,624 completed 
interviews. 
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and locator training and performance, the individual survey questions, or other aspects of the data 
collection process. 

The statistical quality control (SQC) monitoring procedure used in B&B extends traditional 
monitoring criteria, which focus specifically on interviewer performance, to an evaluation of the data 
collection process in entirety. The improved SQC monitoring system randomly selects active work 
stations and segments of time to be monitored, determines what behaviors will be monitored and precisely 
how they will be coded, and allows for real-time performance audits, thereby improving the timeliness 
and applicability of corrective feedback and enhancing data quality. 

All in-use work stations were randomly selected at 15 minute intervals for monitoring by a 
supervisor according to pre-scheduled monitoring sessions. Using an on-line data capture program 
equipped with audio and visual capabilities, supervisors responded directly to ongoing interviews by 
entering evaluation data directly onto data capture screens. For assessment of locating skills, the monitor 
assigned performance ratings to various skills on a 0-5 scale where “0" indicates the skill was not 
observed, and ratings of 1-5 correspond to increasingly higher level of skill mastery and acceptability. 
The data capture screen also allowed supervisors to log question numbers associated with errors and 
general comments pertaining to these errors. Another data capture screen collected very general 
information and commentary on non-interviewing activities such as refusal conversion. Lastly, a 
summary screen allowed monitors to record observations of skill (or lack of skill) for the entire evaluation 
session using the 0-5 rating scale. 

Consistent with the daily production reports generated for system monitoring, statistics were 
reported daily for interviewers’ sessions. Daily statistics are presented in table 3.5. Control charts were 
utilized to track the average number of errors associated with each minute of observed interviewing. Error 
rates for project staff stayed within the predetermined limits set for the phone center. In addition, Pareto 
analysis was utilized to identify the most frequently observed errors encountered in a monitoring session. 
Taken together, these quality control measures ensured the integrity of the data garnered during data 
collection. 

Quality control procedures were also established for field interviewing. The first two interviewer- 
administered completed questionnaires were directed to a FM for editing. These cases were edited, 
logged, and appropriate feedback given to the interviewer. Additionally, ten percent of these cases - 
whether administered over the phone or in person - were validated by FMs. When deemed necessary, 
the FM continued to edit additional cases to monitor data quality. The need for additional monitoring was 
based on the FM’s subjective judgement of the FI’s level of skill. As with the edited cases, validated 
cases were logged and reported weekly. 
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Table 3.5.— Total number of interviewing minutes monitored and error rates 



Date 


Total 


Minutes 


Error 


Date 


Total 


Minutes 


Error 




Errors 


Monitored 


Rate 




Errors 


Monitored 


Rate 


6/15/94 


1 


81.18 


0.01 


8/08/94 


0 


120.60 


0.00 


6/16/94 


5 


201.57 


0.02 


8/09/94 


3 


180.88 


0.02 


6/17/94 


0 


7.42 


0.00 


8/10/94 


0 


81.20 


0.00 


6/18/94 


3 


1 60.42 


0.02 


8/11/94 


2 


101.12 


0.02 


6/19/94 


8 


114.33 


0.07 


8/12/94 


0 


0.00 


0.00 


6/20/94 


0 


112.92 


0.00 


8/13/94 


3 


104.50 


0.03 


6/21/94 


2 


172.05 


0.01 


8/14/94 


15 


105.02 


0.14 


6/22/94 


12 


199.65 


0.06 


8/15/94 


5 


135.63 


0.04 


6/23/94 


4 


164.27 


0.02 


8/16/94 


2 


166.13 


0.01 


6/24/94 


0 


21.88 


0.00 


8/17/94 


3 


58.02 


0.05 


6/25/94 


3 


109.75 


0.03 


8/1 8/94 


1 


154.27 


0.01 


6/26/94 


0 


56.52 


0.00 


8/19/94 


0 


0.17 


0.00 


6/27/94 


8 


155.77 


0.05 


8/20/94 


4 


83.42 


0.05 


6/28/94 


8 


161.45 


0.05 


8/21/94 


10 


41.88 


0.24 


6/29/94 


13 


163.73 


0.08 


8/22/94 


1 


87.38 


0.01 


6/30/94 


4 


236.58 


0.02 


8/23/94 


4 


89.05 


0.04 


7/01/94 


3 


25.43 


0.12 


8/24/94 


2 


84.77 


0.02 


7/02/94 


0 


87.63 


0.00 


8/25/94 


4 


142.00 


0.03 


7/03/94 


5 


32.17 


0.16 


8/26/94 


0 


15.73 


0.00 


7/05/94 


5 


199.30 


0.03 


8/27/94 


1 


99.17 


0.01 


7/06/94 


7 


156.20 


0.04 


8/28/94 


8 


66.82 


0.12 


7/07/94 


0 


155.48 


0.00 


8/29/94 


0 


96.33 


0.00 


7/08/94 


3 


17.30 


0.17 


8/30/94 


4 


87.35 


0.05 


7/09/94 


1 


220.43 


0.00 


8/31/94 


0 


69.57 


0.00 


7/10/94 


1 


62.38 


0.02 


9/01/94 


0 


43.25 


0.00 


7/11/94 


1 


52.00 


0.02 


9/02/94 


2 


14.42 


0.14 


7/12/94 


1 


181.85 


0.01 


9/03/94 


0 


16.22 


0.00 


7/13/94 


4 


59.63 


0.07 


9/04/94 


0 


26.75 


0.00 


7/14/94 


10 


86.38 


0.12 


9/06/94 


0 


78.15 


0.00 


7/15/94 


0 


0.00 


0.00 


9/07/94 


2 


55.45 


0.04 


7/1 6/94 


2 


55.00 


0.04 


9/08/94 


2 


73.40 


0.03 


7/17/94 


3 


97.85 


0.03 


9/09/94 


0 


0.00 


0.00 


7/18/94 


9 


175.98 


0.05 


9/10/94 


0 . 


46.68 


0.00 


7/19/94 


12 


198.80 


0.06 


9/11/94 


0 


23.12 


0.00 


7/20/94 


13 


147.90 


0.09 


9/12/94 


2 


91.58 


0.02 


7/21/94 


10 


135.03 


0.07 


9/13/94 


3 


72.15 


0.04 


7/22/94 


3 


25.93 


0.12 


9/14/94 


0 


69.35 


0.00 


7/23/94 


0 


55.63 


0.00 


9/15/94 


1 


53.13 


0.02 


7/24/94 


2 


34.42 


0.06 


9/16/94 


0 


28.32 


0.00 


7/25/94 


5 


136.95 


0.04 


9/17/94 


0 


99.28 


0.00 


7/26/94 


9 


104.33 


0.09 


9/18/94 


2 


51.43 


0.04 


7/27/94 


1 


120.75 


0.01 


9/19/94 


0 


100.28 


0.00 


7/28/94 


13 


143.08 


0.09 


9/20/94 


1 


37.60 


0.03 


7/29/94 


2 


46.70 


0.04 


9/21/94 


2 


62.47 


0.03 


7/30/94 


0 


60.30 


0.00 


9/22/94 


1 


115.77 


0.01 


7/31/94 


0 


56.82 


0.00 


9/23/94 


0 


0.00 


0.00 


8/01/94 


0 


157.40 


0.00 


9/24/94 


0 


36.02 


0.00 


8/02/94 


5 


129.00 


0.04 


9/25/94 


0 


45.23 


0.00 


8/03/94 


5 


111.82 


0.04 


9/26/94 


0 


79.47 


0.00 


8/04/94 


0 


108.50 


0.00 


9/27/94 


0 


77.93 


0.00 


8/05/94 


0 


44.18 


0.00 


9/28/94 


0 


38.88 


0.00 


8/06/94 


0 


45.90 


0.00 


9/29/94 


0 


16.87 


0.00 


8/07/94 


7 


101.08 


0.07 


Total 


303.00 


9373.25 


0.0 
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4.0 Response Rates 

B&B:93/94 interviewers achieved a 92 percent response rate. Table 4.1 presents information on 
the final disposition for all cases that were initially included in the sample. In all, 12,478 of the cases that 
were identified as potential B&B sample cases during the NPSAS data collection were included in the 
B&B data collection 5 . Of these cases, 1520 were found to be ineligible or out of scope, primarily because 
their graduation date fell outside the July 1 - June 30 window. A total of 10,958 cases were considered 
to be eligible during the interviewing period of B&B:93/94, and interviews were completed with 10,080 
(92%) of these respondents. 

The majority of interviews were conducted by telephone interviewers located at a central facility, 
using a computer-assisted telephone interviewing system. Approximately 68 percent of eligible cases 
were completed in the telephone center; another 2 percent were designated as final non-respondents. 

The remaining 3698 cases (30 percent) were sent to field interviewers who were geographically 
dispersed across the country. The majority of these cases had been contacted by telephone interviewers, 
but had not been completed because the respondent had refused. Others were referred because the 
telephone center had been unable to locate the respondent, or to speak personally to the respondent to 
complete the interview. Field interviewers completed an additional 2624 interviews, about 70 percent 
of those that were sent to the field, bringing the cumulative total of completed cases to 10,080. 

An examination of the final dispositions shows that 92 percent of eligible respondents participated 
in the study, approximately 6 percent refused to take part, and another 1 percent did not participate for 
other reasons. Just under 1 percent of respondents could not be located. 

Table 4.2 presents more detailed information on respondents and non-respondents by age, sex, 
and ethnic background. Table 4.2 contains information concerning the percentage each subgroup that 
completed the interview. Response rates were similar across almost all of these demographic subgroups. 
Ninety-nine percent of young respondents (those 22 and under) participated, while approximately 91 
percent of those over 22 participated. Males and females participated at approximately equal rates. 
Response rates were approximately equal among whites, blacks, and American Indians - 93 percent of 
eligible respondents in each group participated. Among Asians and Pacific Islanders, the completion rate 
was slightly lower, just under 90 percent. 

The comparatively high rate of non-response that appears in Table 4.2 for those sample members 
in which age, sex, or race is missing results from the fact that many of these cases were non-respondents 
in NPSAS, as well as B&B:93/94. 



5 The 12,478 cases worked during B&B:93/94 represent a 98 percent sample of the total number of cases (12,768) referred 
as potentially eligible. A random selection procedure was used to exclude 290 cases to ensure that the study could be completed 
within budget. 
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Table 4.1.— Response rates by mode of interview 



Total eligible 




Phone 


Field 


Total 


Complete 


(percent) 


68.0% 


23.9% 


92.0% 




(number) 


7456 


2624 


10080 


Final refusal 


(percent) 


1.7% 


4.1% 


5.8% 




(number) 


191 


448 


639 


Other Non- 


(percent) 


0.4% 


1.0% 


1.3% 


response 


(number) 


39 


105 


144 


Unlocated 


(percent) 


0.0% 


0.9% 


0.9% 




(number) 


0 


95 


95 


Subtotal 




70.1% 


29.9% 


100.0% 






7686 


3272 


10958 






1094 


426 


1520 


Total ineligible 




Total cases worked 


8780 


3698 


12478 



SOURCE: NCES, Baccalaureate and Beyond: 93/94 
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Table 4. 2. -Case disposition by demographic characteristics of sample 





Complete 


Refused 


Unlocatable 


Other Non- 
response 


Total eligible 


Age 


Under 22 


99.3% 


0.4% 


0.1% 


0.1% 


100.0% 




2689 


11 


4 


4 


2708 


23-29 


90.1% 


7.2% 


1.7% 


1.7% 


100.0% 




5764 


458 


111 


111 


6397 


30 or over 


91.3% 


6.5% 


1.1% 


1.1% 


100.0% 




1596 


114 


20 


20 


1748 


Missing 


29.5% 


53.3% 


8.6% 


8.6% 


100.0% 




31 


56 


9 


9 


105 


Subtotal 


92.0% 


5.8% 


0.9% 


1.3% 


100.0% 




10080 


639 


95 


144 


10958 


Sex 


Male 


92.7% 


4.9% 


i.i% 


1.4% 


100.0% 




4377 


233 


50 


64 


4724 


Female 


91.5% 


6.5% 


0.7% 


1.3% 


100.0% 




5703 


405 


45 


80 


6233 


Missing 


0.0% 


100% 


0.0% 


0.0% 


100.0% 




0 


1 


0 


0 


1 


Subtotal 


92.0% 


5.8% 


0.9% 


1.3% 


100.0% 




10080 


639 


95 


144 


10958 


Race 


White 


92.7% 


5.6% 


0.7% 


1.0% 


100.0% 




8710 


525 


62 


97 


9394 


Black 


93.0% 


4.1% 


1.3% 


1.5% 


100.0% 




628 


28 


9 


10 


675 


American 


93.3% 


4.0% 


0.0% 


2.7% 


100.0% 


Indian 


70 


3 


0 


2 


75 


Asian/Pacific 


89.7% 


4.9% 


3.1% 


2.3% 


100.0% 


Islander 


437 


24 


15 


11 


487 


Other/Missing 


71.9% 


18.0% 


2.8% 


7.3% 


100.0% 




235 


59 


9 


24 


327 




92.0% 


5.8% 


0.9% 


1.3% 


100.0% 




10080 


639 


95 


144 


10958 



SOURCE: NCES, Baccalaureate and Beyond: 93/94. 
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5. Evaluation of Instrument 

5.1 Length of Interview 

The use of Computer-Assisted Telephone Interviewing yields many advantages, one of which is 
accurate evaluation of the length of time elapsed during the completion of each section of the interview. 
The CATI instrument used in this study included several "time stamps" which enable us to look carefully 
at the amount of time taken by the "average" respondent to complete each section. These data are 
presented in Table 5.1. The instruments used for data collection in the NPS AS:93 and B&B:93/94 studies 
are presented in Appendices C and D, respectively. 

The average length of a completed interview was 32 minutes. Of this, approximately 2 minutes 
was spent updating information about the undergraduate career that was missing in the NPSAS file. 
Within the B&B interview, approximately 6 minutes was spent collecting information about post- 
baccalaureate education. Another 8 minutes was spent collecting information about the respondent's work 
since graduating from college, and approximately 3 minutes was spent gathering information about 
training experiences since college graduation. The demographics, civic participation, and educational 
loan sections of the interview comprised approximately 12 minutes. 

A subsample of respondents were asked about their experiences teaching in elementary and 
secondary schools since receiving their baccalaureate degrees. Among those asked these questions, 
another 6.45 minutes was spent collecting these data. However, when averaged across all respondents, 
less than one minute was spent in collecting this information. 

Table 5.1 .—Interview administration time by section 



(Average number of minutes respondents spent answering questions) 



Section Name 


Minutes 


Introduction (update missing information) 


2.28 


Education section 


5.82 


Employment section 


7.98 


Teaching section 


0.78 


Training sections 


3.33 


Final sections: demographic, financial and 
tracing information 


11.87 


Total 


32.01 



SOURCE: NCES, Baccalaureate and Beyond: 93/94. 
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5.2 Non-response by Item 

One of the goals of B&B was to reduce item non-response by using a variety of innovative 
techniques to build respondent rapport, including the use of conversational interviewing. Neverthe less, 
some items, particularly those requiring the recollection of specific numeric figures (i.e., test scores and 
dates; income figures) were answered by less than 90 percent of respondents who were asked. These 
items are displayed in table 5. 2. 6 

Of the over 1,000 variables included in the final data set, 68 variables contain over 10 percent 
missing data, due to respondents declining to answer the question, or responding that they could not give 
an accurate answer. The first section of Table 5.2 contains items concerning graduate entrance 
examinations and professional licensing exams. The largest categories of non-response in this table are 
the “don’t know” responses to items concerning test scores and dates. It should be noted that “don’t 
know” can sometimes be a legitimate response to the test score item, since some respondents had taken 
a test but had not yet received word of their scores. In other instances, “don’t know” signifies that the 
respondent had difficulty recalling the information requested and could not provide a number. High 
levels of don’t know responses are also evident in the items regarding college grades. 

Respondents also had difficulty recalling detailed information concerning undergraduate loans 
and loan payments when the respondent had more than three loans. Respondents were asked about each 
type of loan individually, and information on up to seven loans was collected. Item non-response appears 
to be a problem for information collected- on- loaft^ four through seven. Note-that relatively few 
respondents were asked about this number of loans. 

As in other surveys, items that required respondents to reveal exact dollar amounts for income 
were not answered by some respondents. One item with high non-response, HSEHDIN, was only asked 
of respondents who said they were “head of the household” and were living with another adult, other than 
a spouse. The next three items that appear in the table, TOTINCS , ANNINCS, and TOTINCM were 
asked as a closed-ended categorical question when the respondent did not provide an answer to the 
original question. When these income questions are combined into a single categorical variable, non- 
response is under 15 percent. 

Few of the remaining items have significant non-response. It is especially notable that the two 
primary sections of the survey, concerning post-baccalaureate education and employment, had very little 
missing data. 



6 This list does not include items that were pre-loaded using NPSAS data, or other items that were designed 
as components of composite variables. 
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Table 5.2.-Item non-response for items with more than 10% “Don’t know" or “Refused." 

Number Percent Percent Percent combined Percent (1) 

Variable label asked don't know refused non-response non-response. 



Exams and grades 
SCOREDAT 


DAT score 


59 


SCRADGRE 


Advanced GRE score 


152 


SCORGMAT 


GMAT score 


549 


actsrang 


ACT score range 


1185 


PASSNTE 


Pass/fail status of NTE 


782 


SCRAGRE 


GRE score for analytic section 


1925 


SCOREMAT 


MAT score 


185 


SCRVGRE 


GRE score for verbal section 


1924 


SATSRANG 


SAT score range 


1973 


SCORLSAT 


LSAT score 


562 


SCORMCAT 


MCAT score 


345 


ACCNTPAS 


Accounting exam score type 


80 


STE01PAS 


State teaching exam 1 score type 


608 


SATSCORE 


SAT score 


6701 


STE02PAS 


State teaching exam 2 score type 


77 


REALTPAS 


Real estate exam score type 


73 


PASSNURS 


Pass/fail status of nursing exam 


137 


ACTSCORE 


ACT score 


4546 


DATDATE 


Date took DAT 


r *59 


CUMGRADE 


Grades in all undergraduate 


225 


GRDSMAJ 


courses 

Grades in undergraduate major 


505 


ENG1NPAS 


Engineer exam score type 


154 


NURSDATE 


Date took nursing exam 


139 


Undergraduate 

loans 

TOTLOANS 


Spouse's loans still owed 


984 


TOTALBAL 


Spouse's education loans 


981 


MONPAY05 


deferred? 

Monthly payments on loan (5) 


50 


LN05DUDT 


Date first payment due on loan 


102 


LN06DUDT 


(5) 

Date first payment due on loan 


41 


LNFORG1V 


(6) 

Amount of undergraduate debt 


77 


LN05PYDT 


forgiven 

Date of last payment on loan (5) 


51 


LN04DUDT 


Date first payment due on loan 


281 


DEFER04 


(4) 

Any deferment for loan (4) 


80 


MONPAY04 


Monthly payments on loan (4) 


159 


PAYPLN05 


Repayment plan for loan (5) 


51 


LN03DUDT 


Date first loan payment due (3) 


750 


LN04PYDT 


Date of last payment on loan (4) 


159 



71.2% 


0.0% 


71.2% 


71.2% 


57.9% 


0.0% 


57.9% 


57.9% 


56.6% 


0.2% 


56.8% 


56.8% 


52.7% 


1.0% 


53.7% 


53.7% 


53.3% 


0.3% 


53.6% 


53.6% 


51.5% 


0.5% 


51.9% 


51.9% 


50.8% 


0.5% 


51.4% 


51.4% 


49.7% 


0.5% 


50.2% 


50.2% 


47.9% 


1.1% 


49.0% 


49.0% 


44.7% 


1.2% 


45.9% 


45.9% 


41.7% 


0.9% 


42.6% 


42.6% 


36.3% 


0.0% 


36.3% 


36.3% 


32.6% 


0.2% 


32.7% 


32.7% 


29.8% 


0.4% 


30.2% 


30.2% 


28.6% 


0.0% 


28.6% 


28.6% 


24.7% 


2.7% 


27.4% 


27.4% 


27.0% 


0.0% 


27.0% 


27.0% 


26.4% 


0.3% 


26.7% 


26.7% 


25.4% 


0.0% 


^25.4% 


25.4% 


13.8% 


5.3% 


19.1% 


19.1% 


15.6% 


2.0% 


17.6% 


17.6% 


15.6% 


0.0% 


15.6% 


15.6% 


10.8% 


0.0% 


10.8% 


10.8% 



29.9% 


1.0% 


30.9% 


30.9% 


21.3% 


0.8% 


22.1% 


22.1% 


18.0% 


4.0% 


22.0% 


22.0% 


15.7% 


2.0% 


17.6% 


17.6% 


17.1% 


0.0% 


17.1% 


17.1% 


16.9% 


0.0% 


16.9% 


16.9% 


9.8% 


5.9% 


15.7% 


15.7% 


13.9% 


1.4% 


15.3% 


15.3% 


11.3% 


3.8% 


15.0% 


15.0% 


10.7% 


3.1% 


13.8% 


13.8% 


7.8% 


5.9% 


13.7% 


13.7% 


10.4% 


0.9% 


11.3% 


11.3% 


8.2% 


2.5% 


10.7% 


10.7% 
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Table 5.2-Continued.— Item non-response for items with more than 10% “Don’t know” or 

“Refused.” 







Number 


Percent 


Percent 


Percent combined 


Percent (1) 




Variable label 


asked 


don't know 


refused 


non-resnonse 


non-resnonse 


TOT1NCS 


Spouse's income from all sources 


361 


39.9% 


0.3% 


40.2% 


40.2% 


ANNINCS 


Spouse's income from job 


396 


34.3% 


0.8% 


35.1% 


35.1% 


TOTINCM 


Estimated income from all 


751 


25.8% 


0.4% 


26.2% 


26.2% 




sources 












ANNINCSP 


Spouse’s income from job 


3138 


12.9% 


10.9% 


23.8% 


23.8% 


TOTINCSP 


Spouse’s income from all sources 


3127 


11.8% 


11.2% 


22.9% 


22.9% 


ANNUINCR 


Respondent’s estimate of job 


796 


21.0% 


1.5% 


22.5% 


22.5% 




income 












TOTINCOM 


Respondent income from all 


9747 


7.9% 


7.2% 


15.1% 


15.1% 




sources 












ANNUINC 


Respondent’s job income 


9764 


8.3% 


6.8% 


15.1% 


15.1% 


Teacher 














SALARY 


Academic year base salary 


1153 


7.5% 


5.3% 


12.8% 


12.8% 


LENGTH 


Length of contract 


1169 


9.4% 


0.6% 


10.0% 


10.0% 


Demographic 

information 














FATHEMIG 


Year father emigrated to U.S. 


1108 


9.9% 


1.9% 


11.8% 


11.8% 


MORTGAG 


Monthly mortgage payment 


1961 


1.6% 


9.6% 


11.2% 


11.2% 


AIDELIG 


Eligibility for school aid as 
noncitizen 


187 


10.7% 


0.0% 


10.7% 


10.7% 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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5.3 Reinterviews 

A group of 100 respondents was recontacted several weeks after being interviewed. These 
respondents were asked a subset of items included in the initial interview to help assess the quality of 
those items. Since resources were limited, we focused on items from the education and employment 
sections that had been problematic in the field test, and were modified between the field test and the main 
survey. 



Table 5.3 provides information on the discrepancies between responses to education items in the 
two interviews. Results indicate that the questions elicited similar information in both interviews. Ninety- 
two percent of respondents gave consistent responses when asked whether they had taken any courses 
for credit since graduating from college. Of the eight percent in which responses were inconsistent, most 
were cases in which a short enrollment spell was mentioned in the initial interview that was not reported 
in the reinterview. 

As a followup to this question, respondents were asked to name the school they attended; all 
respondents except one provided consistent names across both interviews. Eighty-five percent of all 
cases had similar information concerning dates of attendance, and eighty-seven percent had consistent 
information concerning the usual time of attendance in the two interviews. 

Table 5.4 presents information on the consistency of responses to employment items. Ninety-six 
percent of respondents gave consistent information across surveys when asked whether they had worked 
since graduation. 7 Almost three-quarters of respondents gave the same number in both surveys when 
asked about the number of jobs they held since graduation; twenty-six percent gave inconsistent 
responses. Upon closer scrutiny, many of the discrepancies resulted from jobs held around the time of 
graduation that were reported in one survey, but not the other. Respondents were asked about the 
number of jobs held since graduating; interviewers were instructed to include jobs that began before 
graduation if the job ended after graduation. Confusion over whether to include such jobs accounts for 
many of the inconsistencies noted in the reinterview. 

Information about the beginning and ending dates of jobs and about unemployment status during 
the periods between jobs were used to construct month-by-month employment status variables for each 
respondent. In the table below, the average number of discrepancies across interviews in monthly 
employment status is presented for three periods: the period preceding graduation for most respondents, 
the summer following the modal graduation date, and the academic year following the modal graduation 
date. It appears that information was reliably captured for all months except for the summer months 
following graduation — approximately 28 percent of cases contained inconsistent data concerning 
employment status in the summer months. These inconsistencies are due to several causes. For example, 
in some cases the beginning and ending dates of jobs are off by a month; in other cases a job held at the 
time of graduation is included in one interview and not another. Among respondents who were not 
working, there is some inconsistency in whether they are classified as unemployed or out of the labor 
force during this time. 



7 Jobs held between the original interview and the reinterview were excluded from all analyses. 
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Table 5.3.— Consistency between original interview data and reinterview data: 
education items 



(Number of Respondents = 100) 



Variable 




Consistent 
in both 


Inconsistent 
due to 
skip pattern 


Inconsistent 
valid codes 


Post-baccalaureate education 

Have you taken any courses, for 
credit, offered by a college, university, 
technical or vocational school, since 
graduation. 


92% 


0% 


8% 


IPEDS code 

What is the name and location of the 
school you attended? 


91% 


8% 


1% 


Dates of attendance 

Did you attend this school in 

199(2,3,4)? 

IF NO, ENTER NOT ATTENDING 
FOR EACH MONTH. 

IF YES: in what months did you 
attend full time (ENTER THE 
MONTH) and in what months did you 
attend part time? 


85% 


8% 


7% 


Usual time of attendance 
When (do/did) you usually attend 
classes at this school? (Weekdays, 
Weeknights, or Weekends) 


87% 


8% 


5% 



SOURCE: NCES, Baccalaureate and Beyond: 1993/94 
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Table 5.4.-Discrepancies between original interview data and reinterview data: employment 
items 



(Number of Respondents = 100) 



Variable 




Number of discrepancies 




Total 


Due to skip 
patterns 


Discrepant valid 
codes 


Have you worked at any jobs for pay 
since graduation? 


4% 


0% 


0% 


How many jobs have you held since 
graduation? 


26% 


4% 


22% 


Average number of discrepancies in 
employment status, each month: 
July, 1992- April, 1993 


5.6 


NA 


NA 


Average number of discrepancies in 
employment status, each month: 
May, 1993 - August, 1993 


28.2 


NA 


NA 


Average number of discrepancies in 
employment status, each month: 
September, 1993-November, 1994 


9.6 


NA 


NA 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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6. B&B:93/94 Transcript Component 

In addition to data gathered from sample members, B&B:93/94 included a transcript component 
which attempted to capture student-level course-taking and grades for eligible sample members. 
Transcripts were requested for all sample members from the NPSAS schools from which they received 
their bachelor's degrees. Data were captured at both the school and student levels; school-level data such 
as school type, schedule, and grading systems were gathered first and used to guide the entry of student- 
level courses, credit hours, and grades. 



6.1 Transcript Collection Procedures 

Data collection for the transcript component began in August, 1994, when a packet was mailed 
to all 715 NPSAS:93 sample schools from which B&B sample members graduated. The contents of this 
packet included: 

• a B&B informational leaflet; 

• letters from NCES, NORC, and the American Association of Collegiate Registrars and 
Admission Officers; 

• a list of professional organization endorsements; 

• instructions for sending transcripts; 

• a student checklist with the names and other relevant information for each student for 
whom a transcript was requested; 

• a request for reimbursement form and postage paid return envelope in which to send 
student transcripts. 

In addition to student transcripts, schools were asked to provide a course catalog and information on their 
grading and credit-granting systems and school term. A transcript was requested for all 12,478 students 
in the B&B:93 sample, although not all transcripts were coded due to sample member ineligibility (see 
section 6.3 for more information on eligibility criteria). 

Prompting of nonresponding schools began in September, 1994, by the telephone center. An 
attempt was made to address any concerns of the school staff regarding confidentiality or the release of 
transcripts. At this time, NORC prompters also tried to take any steps necessary to assist the registrar or 
other school official in gathering the needed information. The majority of schools (595) had sent their 
transcripts by the end of December 1994. Table 6.1 shows the completion rate for the transcript 
component. In all, 626 of the 635 (99 percent) eligible schools complied with our request for student 
transcripts, resulting in a transcript collection rate of 98 percent at the student level. 
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Table 6.1. -Completion rate for B&B:93/94 transcript component 



Final Disposition 


Schools 


Students 


Received 


626 

(98.6%) 


10970 

(97.8%) 


Refused/final Nonresponse 


9 

(1.4%) 


250 

(2.2%) 


Out-of-scope a 


80 


1258 


Total 


715 

(100.0%) 


12478 

(100.0%) 



a A school (and the sample members attached to it) was considered out-of-scope if it reported that it did not grant 
baccalaureate degrees. Further conditions for student ineligibility are listed in section 6.3. 

SOURCE: NCES, Baccalaureate and Beyond:93/94 



6.2 Transcript Processing Procedures 

The design of the B&B:93/94 transcript processing system capitalized on the work done by 
previous NORC studies (i.e., HS&B, NELS2). The process flow and system however, were changed in 
four significant areas. First, since the sample of schools from which transcripts were collected was 
known, the system was designed around the school as the primary unit, rather than the student. Second, 
transcripts were entered after all school level information about schedule, grading, and credit-granting 
systems were collected and verified. The system enforced these parameters and ensured that the 
transcripts were internally consistent within the school. Third, the transcript coders worked with the full 
transcript when entering and coding courses. This allowed them to view each entry in context and make 
intelligent, informed decisions when difficult situations were encountered. Finally, the system was 
designed so that course-level information (in a unique school) was only entered once; subsequent 
duplicate course entries were selected by the coder from a dynamic school-level list of all courses entered 
from previous transcripts. 

School-level coding. Receipt control and data entry of course catalogs, grading system 
descriptions, and school term information from the schools began in September 1994. The institutional 
information was checked for accuracy and completeness, and those schools with incomplete school 
information, missing grading systems, or missing catalogs were contacted to retrieve missing items. 

The grading and credit-granting system used by each school was captured before transcript data 
were entered. The allowable grades, their quality points (the points per credit for the grade), and the 
grades counting toward credit were entered into the master grading system table. Each school unit in the 
database referenced a unique grading system, and only those grades allowed for the school were available 
to course coders. If new grades were found during course coding, entry was stopped until supervisors 
could ascertain the correct grading system for the school. 
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Each course was designated as being a quarter, semester, trimester, clock hour, examination, 
transfer, study abroad, or other term type. The term type designation, however, had no bearing on the 
normalized number of credits assigned to each course on the transcript. Instead, the actual minimum 
number of credits required for a baccalaureate degree was entered at the school level for each school in 
the sample. The number of credits received for each course was entered at the course level, and the 
normalized number of credits for each course calculated by multiplying by 120 over the total credits 
required for a degree. 

Student-level transcript coding. After the school-based information was entered, the transcripts 
were processed; transcript data entry and course coding were combined into one procedure. All 
transcripts from a school were processed by the same coder. Before specific course information was 
entered, general student-level information from the transcript was entered. These data, such as major and 
minor field of study, grade point average, high school graduation date, and baccalaureate degree data were 
entered for all students. 

Transcripts are typically organized by courses taken per term. Keeping the course-term link is 
important for reporting intensity of enrollment. Terms are also important in determining the uniqueness 
of a course. Courses are unique by school, course abbreviation, and term. This allows for separate 
coding of special study courses that vary from term to term (i.e., "Special Studies: Babbage and the 
history of early Computers"; next term, same department "Special Studies: Advanced Fractal/Chaos 
Applications"). In order to maintain this link, transcript data were entered term-by-term. The coder chose 
the term description (e.g., Winter, '90) from the list set up for that school, and then proceeded to enter the 
courses within that term. Courses or blocks of courses which came from outside sources (e.g., transfer, 
foreign study, advanced placement credit) were entered by source, and the source noted in the term 
description field. 

Within each school, all course abbreviations (i.e., ENGL 101), titles, usual credits, and course 
codes were stored as new courses were discovered, entered, and coded. When the coder entered the 
course abbreviation, any title previously stored was displayed. If the title matched the transcript, the 
coder accepted the entry and verified the number of credits. Note that the number of credits granted for 
a course was edited since it varied from student to student. For example, Independent Study courses may 
vary greatly in the number of credits earned. Also, some courses may have optional labs or discussion 
groups. After verifying the credits, the grade was selected. Only grades from the school's grading system 
list were allowed. Any disallowed grades were investigated and resolved by the transcript supervisor, 
usually by researching the course catalog or school institution data or by calling the registrar. 

If the course didn't match a pre-existing entry, the coder searched the school-level table to see if 
other courses existed for the abbreviation. If a course did not exist in the table, the coder entered the full 
course title, the number of credits, and the grade. These procedures allowed for a robust, automated, 
school-level course database which greatly improved the quality, and increased speed and efficiency of 
transcript data entry. Figure 6.1 provides an illustration of the flow of materials in transcript data 
collection. 



Although transcripts were requested from only the baccalaureate degree granting institutions, 
these transcripts often were sent to us with transcripts from previous transfer schools attached. A decision 
was made to code these transcripts. However, no attempt was made to collect additional information from 
these 1 ,938 schools. Because we lack the school-level information for these transcripts, this information 
is not the same quality as information coded from the baccalaureate transcripts. 
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Figure 6.1 B&B transcript schools and courses coded 




Student Transcripts 
10,970 




Transfer Schools 
1,938 


1 


A 

f 




Courses Coded 
for Sample 
School 
546,911 


► 


Courses Coded 
from Transfer 
Schools 
65,682 



SOURCE: NCES, Baccalaureate and Beyond:93/94 

6.3 B&B:93/94 Transcripts Eligibility Criteria 

During the course of transcript collection, it was found that some NPSAS sample schools from 
which a sample member was reported to have received a bachelor’s degree, actually did not offer that 
degree. In most cases this was confirmed by data on the school in the Integrated Postsecondary Education 
Data System (IPEDS) database. Students attached to these sample schools were considered out-of-scope 
for transcript processing. In other cases, the school did grant baccalaureate degrees but did not award a 
degree to the student. Again the student was considered out-of-scope. In most of these out-of-scope 
cases ineligibility was confirmed by the respondent questionnaire status. In all cases where the 
respondent was eligible in the B&B CATI (completed the questionnaire or non-response) and a transcript 
was received, the transcript was entered regardless of whether or not a bachelor’s degree was awarded. 
The determination of transcript eligibility involved the interaction of both transcript status and 
questionnaire status. Table 6.2 shows the matrix of questionnaire dispositions and transcript dispositions. 
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Table 6. 2. --Questionnaire-transcript status interaction 



Transcript status 


Questionnaire 

complete 


Questionnaire 

non-response 


Questionnaire 

ineligible 


Transcript received: 


BA in range 


Eligible; Code 


Eligible; Code 


Eligible; Code 


BA not in range 


Eligible; Code 


Review for eligibility 


Ineligible; Don't 
Code 


BA not awarded 


Eligible; Code 


Review for eligibility 


Ineligible; Don't 
Code 


Transcript not received: 


No record of student at 
school 


Transcript non- 
response 


Review for eligibility 


Ineligible 


BA not awarded 


Transcript ineligible 


Review for eligibility 


Ineligible 


School refused 


Transcript non- 


Transcript non- 


Transcript 




response 


response 


ineligible 



SOURCE: NCES, Baccalaureate and Beyond:93/94 



As shown above, the combination of questionnaire and transcript status resulted in various final 
outcomes, which then informed the decision whether or not to process the transcript or count the sample 
member as eligible. The final eligibility criteria are best defined as: 

A sample member is eligible for B&B:93/94 if he or she received a baccalaureate degree from 

the sample school between July 1, 1992 and June 30, 1993; OR 

If he or she completed a B&B interview and satisfied one of the following criteria: 

• received a baccalaureate degree from another school during the reference 

period; 

• earned at least 75 percent of the credits needed for a baccalaureate degree from 
the NPSAS school; 

• the respondent interview data showed that he or she attended multiple schools. 

Table 6.3 provides information on the eligibility of cases in the interview and transcript 
components of the study. Any case that was found to be eligible in either component of the study will 
be retained for future rounds. (In the CATI study, eligibility was determined by respondents’ self- 
reported graduation.) Excluded from future follow-up will be the 1178 cases that were found to be 
ineligible in both components of the study, as well as the 108 cases that were found to be ineligible in one 
component and were non-respondents in the other. Thus, 11,192 cases will be followed in subsequent 
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rounds of the study. It should be noted that regardless of eligibility prior, only those respondents who 
reported having completed their baccalaureate degree in the course of the interview were retained as 
interview completers. 

Table 6.3. — ' Transcript and CAT! eligibility 



Dispositions 


CATI 

eligible 


CATI 

ineligible 


CATI 
non-interview 
(Eligibility unknown) 


Transcript 

eligible 


9876 


267 


827 


Transcript 

ineligible 


44 


1178 


36 


Transcript 
nonresponse 
(Eligibility unknown) 


160 


72 


18 


Totals 


10,080 


1,517 


881 



SOURCE: NCES, Baccalaureate and Beyond: 93/94. 



6.4 Quality Control 

The transcripts data entry system was designed to minimize the majority of coding and entry 
errors which occur with tasks of this type. Based on the most up-to-date experiences with the NELS 
Third Follow-up transcript component, a data entry program was designed to automate as many of the 
data entry steps as possible. As described in section 6.2, much of this automation occurred on the course 
level, where the bulk of data entry errors usually take place. 

In addition to system design, the coding supervisors regularly undertook quality control checks 
of entered data, as well as monitoring individual coders. Analyses of interim data files created during 
production showed that the problematic areas for data entry occurred with transfer schools and transfer 
credits. While some transfer transcripts were entered, the quality of these data is not at the same level as 
data from the sample school transcript for several reasons: (1) transfer transcripts were not requested from 
the transfer school and therefore, were not systematically received; (2) full information about the transfer 
schools was not obtained (i.e., course catalogs, number of credits required for degree, type of credits 
granted, etc.). 
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7. Weights Development Documentation for B&B:93/94 Sample 



B&B:93/94 final weights were calculated by adjusting the baseline National Postsecondary 
Student Aid Survey (NPSAS:93) weights. Adjustments were made for tighter B&B eligibility criteria 
applied in B&B:93/94 and for nonresponse in the B&B:93/94 survey. NPSAS:93 sample development 
and weights calculation documentation can be found in "Sampling Design and Weighting Report for the 
1993 National Postsecondary Student Aid Study" published in February, 1995 (Whitmore, Traccarella, 
and Iannacchione, 1995). The B&B:93/94 weights adjustment started with the NPSAS:93 base weight 
calculated for all B&B eligible sample members (N 0 ). A summary of the interim weight components and 
final B&B weight distribution can be summarized as follows: 



Variables defined in the weights development process: 



N 0 : 

B 0 ; 



B,: 

B&BSTRAT: 

B&BTYPE: 



NPSAS:93 base weight 

NPSAS:93 base weight (with imputed values for 23 missing base weights and) 
adjusted for new baccalaureate degree control totals 

B&B:93/94 final weight adjusted for nonresponse (non-respondents are assigned 
a value = 0) 

Adjusted institution stratum for B&B weight 
Adjusted student type for B&B weight 



A summary of the final distribution for N 0 , B 0 , and B, is as follows: 



Table 7.1 .— Final distribution 



Variable 


Sum of 
weights' 


Number 
of non-zero 
observations 


Number of 
zero 
observations 


Mean based 
on non-zero 
weight 


Standard 

Deviation 


Minimum 


Maximum 


N 0 


1,025,292.00 


11,169 


23 


91.80 


77.51 


1.00 


2,225.00 


B 0 


1,184,758.02 


11,192 


0 


105.86 


86.15 


1.52 


2,446.50 


B, 


1,184,758.04 


10,080 


1,112 


117.54 


95.57 


1.56 


3,149.07 



'Small difference in sum of weights is due to rounding error. 



SOURCE: NCES, Baccalaureate and Beyond:93/94 




40 



59 



Baccalaureate and Beyond Longitudinal Study 93/94 
First Follow-up Methodology. Report 



7.1 Weights Development Procedure 

Step 1. Calculate the final B&B:93/94 case disposition 

The final B&B:93/94 case disposition for weights development and further analysis was created 
by combining the final survey disposition (CATI) with the final disposition from the Transcript 
component. The final survey disposition reflects the final data collection disposition and includes 
complete cases, cases determined to be ineligible for B&B, and cases for which no response was attained. 
The final transcript component disposition was determined by our ability to collect and code the sample 
member's undergraduate transcript. Information from the transcript was used to determine whether 
sample members were eligible for B&B. The valid values from the transcript component disposition 
include complete (and eligible), ineligible, and not received. Refer to table 6.3 for the breakdown of 
transcript and CATI eligible cases. 

The final disposition of all cases is presented in table 7.2. 

Table 7.2.-Final dispositions 



Final analysis disposition 


Total 


CATI complete and transcript 
complete 


9,876 


CATI complete no transcript 


204 


CATI non-respondent; 
transcript complete 


1,094 


Eligibility unknown 
CATI + transcript incomplete 


18 


Subtotal: 


11,192 


Determined ineligible in CATI 
or transcripts 


1,286 


Total 


12,478 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Step 2. Collapse institution stratum and student type cells. 

NPSAS:93 interviews were completed, and B&B eligible sample members were identified, from 
all 22 institution strata and all 5 student types defined in the NPSAS:93 sample universe. For the purpose 
of control total, and non-response, adjustments the B&B:93/94 sample were collapsed into 48 cells. 
These 48 cells include the 16 institution strata containing institutions which grant baccalaureate degrees, 
and within each stratum three student types (baccalaureate degree eligible-business majors (type 4), 
baccalaureate degree eligible-all other degrees (type 5), and all other students (types 1-3 collapsed into 
type 3). The following rules were used to collapse student type and institution stratum: 

Student Type: 

1 . If student type =1 (other undergraduates) or 

=2 (graduates) or 

=3 (first professional students) 

Set B&BTYPE =3 (other) 

2. Else B&BTYPE = student type 

Institution Stratum: 

1. If institution stratum (IS) = 17 (public, 2- year) or 

= 20 (public less-than-2-year) 

Set B&BSTRAT =14 (Public, 4-year, bachelors, low ed) 

[IS 17 (10 cases)+IS 20 (0 cases)=10 cases recoded] 

2. Else if institution stratum = 18 (private, not-for-profit, 2-year) or 

= 19 (private, for-profit, 2-year) or 
= 21 (private, not-for-profit, less-than-2-year) or 
= 22 (private, for-profit, less-than-2-year) 

Set B&BSTRAT =16 (private, 4-year, bachelors, low ed) 

[IS 18 (1)+IS 1 9(2)+IS 21(2)+IS 22(4)=9 cases recoded] 

3. Else set B&BSTRAT = institution stratum 
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After collapsing institution stratum and sample type, the distribution of B&BSTRAT and 
B&BTYPE for the 1 1,192 eligible B&B sample members is as follows: 

Table 7. 3. -Control totals by institution stratum 



B&BSTRAT x B&BTYPE 


Type 3 
other 
under- 
graduates 


Type 4 
BA 
business 
majors 


Type 5 
BA 
other 
majors 


Total 


1. Public, 4-year, first-prof, high ed 


27 


39 


378 


444 


2. Public, 4-year, first-prof, low ed 


155 


174 


2,419 


2,748 


3. Private, 4-year, first-prof, high ed 


38 


59 


759 


856 


4. Private, 4-year, first-prof, low ed 


7 


16 


294 


317 


5. Public, 4-year, doctoral, high ed 


17 


42 


379 


438 


6. Public, 4-year, doctoral, low ed 


63 


62 


830 


955 


7. Private, 4-year, doctoral, high ed 


9 


20 


126 


155 


8. Private, 4-year, doctoral, low ed 


3 


4 


148 


155 


9. Public, 4-year, masters, high ed 


31 


27 


328 


386 


10. Public, 4-year, masters, low ed 


119 


183 


1,726 


2,028 


1 1. Private, 4-year, masters, high ed 


5 


14 


155 


174 


12. Private, 4-year, masters, low ed 


60 


135 


1,070 


1,265 


13. Public, 4-year, bachelors, high ed 


2 


16 


109 


127 


14. Public, 4-year, bachelors, low ed 


17 


20 


111 


148 


15. Private, 4-year, bachelors, high ed 


7 


9 


109 


125 


16. Private, 4-year, bachelors, low ed 


28 


92 


751 


871 


Total 


588 


912 


9,692 


11,192 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Step 3. Impute baseline NPSAS.93 weights for 23 eligible B&B sample members and calculate 

updated baccalaureate degree control totals. 

The B&B. 93/94 sample included 26 cases for which the NPSAS;93 baseline weight was equal 
to zero. In B&B:93/94, 23 of these cases were completed and 3 were determined to be ineligible. The 
NPSAS:93 baseline weight for the 23 eligible cases was imputed using the average of all non-zero 
baseline weights within the same institution at which the baccalaureate degree was attained. One of the 
cases with a missing weight happened to be the only representative in their institution. The baseline 
NPSAS:93 weight was imputed for this case by using the average across all non-zero weights within the 
same institution stratum and student type cell. 

The baseline weights for all B&B eligible students were further adjusted for final degree totals. 
Control totals for baccalaureate degrees awarded were calculated based on the IPEDS completions file 
for academic year 1992-1993. The NPSAS institution sample frame was matched to the IPEDS file and 
the total number of baccalaureate degrees awarded was calculated by institution stratum. Table 7.4 
summarizes the control totals for each B&B stratum. 

An adjusted weight B 0 was calculated for each case by multiplying the base weight by the 
ratio of the sum of degrees awarded to the sum of the base weights for the appropriate institution 
stratum. The adjusted total number of baccalaureate degrees for academic year 1992-1993 is 
1,184,758 degrees. This weight will serve as the B&B base weight used in all future weight 
adjustments. 
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Table 7.4.~Estimates of baccalaureate degrees awarded by type of institution used to construct weights 



Institution Stratum 


Sum of the NPSAS:93 base 
weights (Nj) 


Number of baccalaureate 
degrees awarded in academic 
year 1992-1993 


1 . Public, 4-year, first-prof, high ed 


41,359.00 


47,950 


2. Public, 4-year, first-prof, low ed 


247,936.38 


296,486 


3. Private, 4-year, first-prof, high ed 


88,913.14 


104,533 


4. Private, 4-year, first-prof, low ed 


31,422.00 


28,977 


5. Public, 4-year, doctoral, high ed 


38,872.41 


56,165 


6. Public, 4-year, doctoral, low ed 


92,140.96 


106,400 


7. Private, 4-year, doctoral, high ed 


23,681.00 


15,856 


8. Private, 4-year, doctoral, low ed 


15,460.06 


11,759 


9. Public, 4-year, masters, high ed 


32,575.69 


42,165 


10. Public, 4-year, masters, low ed 


181,775.09 


213,132 


1 1 . Private, 4-year, masters, high ed 


7,236.00 


7,636 


12. Private, 4-year, masters, low ed 


104,907.64 


125,733 


13. Public, 4-year, bachelors, high ed 


3,783.26 


5,750 


14. Public, 4-year, bachelors, low ed 


24,867.62 


22,459 


15. Private, 4-year, bachelors, high ed 


10,182.00 


9,395 


16. Private, 4-year, bachelors, low ed 


82,180.93 


90,362 


Total 


1,027,293.18 


1,184,758 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Step 4. Adjust for non-response and calculate final B&B:93/94 weight 

Non-response adjustments for the weight variables were calculated using the following 
process: 

1 . Non-response adjustment cells were created by cross-classifying cases by two 
variables: institution stratum and student type. 

2. Each cell was checked to see that it met two conditions: 

• the cell contained at least 15 students 

• the weighted response rate for the cell was at least two-thirds 
(67%) of the overall weighted response rate. 

3. Any cells that did not meet both conditions were combined into larger cells. 
This was done by combining student types 3 and 4 within the same 
institutional stratum. If this larger cell did not meet the criteria specified 
above, all student types from that institutional stratum were combined. 

4. Once all cells were defined, the B&B weight variable was multiplied by the 
inverse of the weighted response rate for the cell. 



In more formal terms, if we define the indicator I hbi = 1 if surveyed B&B sample member I in student 
stratum b and institutional stratum h responded to the survey, and let I hbi = 0 if the sample member 
did not respond to the survey, then the response rate for sample members in institutional stratum h 
and student stratum b, R hb , is 



R, 



"hb 

SB„.I... 

O.i hbi 
i = l 



hb 



"hb 

SB 

i = l 



O.i 



where n hb is the number of sampled students in student stratum b and institutional stratum h. The 
final B&B:93/94 weight adjusted for nonresponse, B 1; is 
B i = iyR hb . 



Final response rates for each strata are presented in the following table. 
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Table 7.5. -Weighted (by B 0 ) response rates by strata 



BBSTRAT 


BBTYPE 


N 


Response Nonresponse 


Rate 


1 


3 


27 


8154.94 


682.86 


0.92273 


1 


4 


39 


7373.53 


979.66 


0.88272 


1 


5 


378 


27418.88 


3340.12 


0.89141 


2 


3 


155 


51471.46 


4509.42 


0.91945 


2 


4 


174 


34791.04 


3222.72 


0.91522 


2 


5 


2419 


183190.91 


19300.45 


0.90469 


3 


3 


38 


13453.25 


2371.34 


0.85015 


3 


4 


59 


13358.02 


1317.93 


0.91020 


3 


5 


759 


64384.86 


9647.59 


0.86968 


4 


3,4 


23 


4508.58 


313.54 


0.93498 


4 


5 


294 


21889.98 


2264.89 


0.90623 


5 


3 


17 


7848.45 


0.00 


1 .00000 


5 


4 


42 


9528.82 


1125.54 


0.89436 


5 


5 


397 


34232.10 


3430.09 


0.90892 


6 


3 


63 


19157.34 


2135.14 


0.89972 


6 


4 


62 


12554.47 


1286.39 


0.90706 


6 


5 


830 


63942.06 


7324.59 


0.89722 


7 


3,4 


29 


6066.27 


1333.11 


0.81984 


7 


5 


126 


7639.75 


816.87 


0.90340 


8 


3,4,5 


155 


11203.76 


555.24 


0.95278 


9 


3 


31 


9388.07 


1193.41 


0.88722 


9 


4 


27 


4868.13 


428.44 


0.91911 


9 


5 


328 


22790.87 


3496.09 


0.86700 


10 


3 


119 


36891.66 


4439.10 


0.89260 


10 


4 


183 


33151.37 


4504.76 


0.88037 


10 


5 


1726 


120932.16 


13212.95 


0.90150 


11 


3,4 


19 


2280.46 


217.39 


0.91297 


11 


5 


155 


4577.80 


560.35 


0.89094 


12 


3 


60 


16858.26 


2056.65 


0.89127 


12 


4 


135 


25186.72 


3430.14 


0.88014 


12 


5 


1070 


69895.56 


8305.68 


0.89379 


13 


3,4 


18 


1459.06 


202.14 


0.87832 


13 


5 


109 


3974.81 


113.99 


0.97212 


14 


3 


17 


9394.49 


0.00 


1.00000 


14 


4 


20 


2180.19 


897.72 


0.70833 


14 


5 


111 


9235.19 


751.41 


0.92476 


15 


3,4,5 


125 


8477.83 


917.17 


0.90238 


16 


3 


28 


9131.76 


2622.43 


0.77689 


16 


4 


92 


20548.38 


2615.83 


0.88707 


16 


5 


751 


49064.02 


6379.59 


0.88494 


Total 




11192 


1062455.26 


122302.74 


0.89677 
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7.2 Design Effects 

The design effect is defined as the ratio of the variance, corrected for the sampling design, to the 
variance based on a simple random sample. Most complex multi-stage sampling designs result in a design 
effect greater than one, that is, the variance of an estimate is actually larger than the variance would be 
had the data been based on a simple random sample. To estimate the variance using information about 
the sample design, it is necessary to use statistical procedures such as Taylor Series approximations, 
Balanced Repeated Replication, or Jacknife Repeated Replication. For B&B:93/94, NORC used the 
Taylor Series procedure to calculate the standard errors. 

The impact of departures from simple random sampling on the precision of sample estimates is 
often measured by the design effect (designated as DEFF), the ratio of the design-corrected variance to 
the variance based on SRS assumptions. The square root of the design effect (also called the root design 
effect, and designated as DEFT) is also useful. The following formulas defined the design effects and 
root design effect for this section: 



DEFF = (DESION-SEI 2 

(SRS-SE) 2 

DEFT = CDESIGN-SEI 

(SRS-SE) 

where DESIGN-SE designates the standard error of an estimate calculated by taking into account the 
complex nature of the survey design, and SRS-SE designates the standard error of the same estimate 
calculated as if the survey design was a simple random sample. 

Standard errors for thirty proportions based on B&B:93/94 data were calculated. Tables 7.7 
through 7.15 present estimates of the design effects for these variables for various subgroups of the 
population. The design effects presented in the first table are based on the entire population; later tables 
present estimates for subgroups by sex, race, and type of school attended. 

For each variable and group, the table contains the percent estimate, the design-corrected standard error, 
the standard error for the same percent estimate based on SRS assumptions, the unweighted n on with the 
estimate is based, the design effect and the root design effect. 

Researchers who use the Data Analysis System prepared for use with B&B:93/94 will find that 
the program automatically produces design-corrected standard errors. Researchers using the restricted 
use files are cautioned to use a package (such as SUDAAN or OSIRIS) which can produce the design- 
corrected standard errors, or to adjust the standard errors produced by typical packages by multiplying 
them by the mean root design effect for that subgroup. 
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Table 7.6. -Design effects for all respondents - B&B:93/94 





Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


28.69 


0.80 


0.45 


10,080 


1.78 


3.15 


Took state/profl licensing exams 


13.03 


0.49 


0.34 


10,027 


1.46 


2.12 


Applied for aid (of those applying for 














post-BA entrance) 


51.33 


1.26 


0.89 


3,150 


1.41 


2.00 


Attended school since graduation 


27.31 


0.61 


0.44 


10,070 


1.37 


1.89 


Received aid (of those who attended 














school since receiving BA) 


61.44 


1.49 


1.21 


1,613 


1.23 


1.51 


Had prior related job experience 


47.28 


0.69 


0.50 


9,963 


1.38 


1.90 


Employed since BA 


94.88 


0.29 


0.22 


9,966 


1.31 


1.73 


Degree is required for job 


55.89 


0.75 


0.54 


8,389 


1.38 


1.91 


Received other similar job offers 


29.29 


0.65 


0.50 


8,448 


1.31 


1.72 


Degree is related to job 


24.95 


0.64 


0.47 


8,453 


1.36 


1.85 


R's job has career potential 


27.98 


0.68 


0.49 


8,424 


1.39 


1.93 


R’s job offers health insurance 


76.34 


0.60 


0.46 


8,420 


1.30 


1.68 


Considered teaching 


30.07 


0.64 


0.46 


9,894 


1.39 


1.93 


Received training from employer 


34.31 


0.70 


0.52 


8,397 


1.35 


1.83 


Has done volunteer work 


35.37 


0.67 


0.48 


9,850 


1.39 


1.93 


Voted in ’92 presidential election 


77.81 


0.67 


0.42 


10,005 


1.61 


2.60 


Speaks a foreign language 


59.70 


0.81 


0.50 


9,817 


1.64 


2.68 


Has children 


18.38 


0.81 


0.39 


9,838 


2.07 


4.30 


Is saving money 


71.13 


0.60 


0.46 


9,751 


1.31 


1.71 


Has educational loans 


38.63 


0.78 


0.49 


9,746 


1.58 


2.50 


Owns home 


21.97 


0.83 


0.42 


9,767 


1.98 


3.92 


Owns car 


82.26 


0.72 


0.39 


9,762 


1.86 


3.47 


Has non-educational debt 


47.67 


0.71 


0.51 


9,707 


1.40 


1.96 


Is disabled 


3.37 


0.23 


0.18 


9,940 


1.27 


1.61 


Has held multiple jobs 


34.22 


0.67 


0.49 


9,416 


1.37 


1.88 


Any unemployment since graduation 


28.66 


0.60 


0.45 


10,080 


1.33 


1.77 


Applied to graduate school 


28.70 


0.67 


0.45 


10,080 


1.49 


2.21 


Attended a two year school 


0.41 


0.08 


0.07 


9,638 


1.23 


1.51 


Has never married 


72.40 


0.93 


0.45 


9,923 


2.07 


4.30 


SUMMARY STATISTICS 














Mean 










1.48 


2.26 


Minimum 










1.23 


1.51 


Maximum 










2.07 


4.30 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7. 7. -Design effects for female respondents - B&B:93/94 



VARIABLES 


Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


29.74 


0.96 


0.61 


5,701 


1.59 


2.51 


Took state/profl licensing exams 


14.37 


0.69 


0.47 


5,668 


1.48 


2.19 


Applied for aid (of those applying for 














post-BA entrance) 


50.91 


1.71 


1.21 


1,704 


1.41 


1.99 


Attended school since graduation 


27.37 


0.80 


0.59 


5,695 


1.35 


1.83 


Received aid (of those who attended 














school since receiving BA) 


60.05 


2.13 


1.67 


858 


1.27 


1.62 


Had prior related job experience 


49.01 


0.89 


0.67 


5,634 


1.34 


1.79 


Employed since BA 


94.60 


0.38 


0.30 


5,636 


1.26 


1.59 


Degree is required for job 


56.15 


0.95 


0.72 


4,793 


1.33 


1.76 


Received other similar job offers 


29.72 


0.84 


0.66 


4,823 


1.28 


1.63 


Degree is related to job 


57.47 


0.96 


0.71 


4,827 


1.35 


1.82 


R’s job has career potential 


37.05 


0.92 


0.70 


4,809 


1.32 


1.75 


R’s job offers health insurance 


75.72 


0.75 


0.62 


4,806 


1.21 


1.47 


Considered teaching 


36.52 


0.87 


0.64 


5,589 


1.35 


1.82 


Received training from employer 


34.17 


0.84 


0.69 


4,792 


1.23 


1.50 


Has done volunteer work 


37.44 


0.81 


0.65 


5,560 


1.25 


1.56 


Voted in ’92 presidential election 


78.73 


0.80 


0.54 


5,661 


1.47 


2.16 


Speaks a foreign language 


59.85 


0.94 


0.66 


5,543 


1.43 


2.04 


Has children 


21.45 


0.95 


0.55 


5,558 


1.73 


2.98 


Is saving money 


71.34 


0.82 


0.61 


5,508 


1.35 


1.81 


Has educational loans 


38.59 


0.95 


0.66 


5,507 


1.45 


2.10 


Owns home 


25.02 


1.01 


0.58 


5,519 


1.73 


3.00 


Owns car 


81.30 


0.86 


0.52 


5,519 


1.64 


2.68 


Has non-educational debt 


49.77 


0.89 


0.67 


5,487 


1.32 


1.74 


Has graduate loan(s) 


4.30 


0.29 


0.27 


5,695 


1.08 


1.16 


Is disabled 


2.86 


0.26 


0.22 


5,612 


1.17 


1.37 


Has held multiple jobs 


35.38 


0.85 


0.66 


5,323 


1.30 


1.68 


Any unemployment since graduation 


27.80 


0.78 


0.59 


5,701 


1.31 


1.73 


Applied to graduate school 


27.42 


0.78 


0.59 


5,701 


1.32 


1.74 


Attended a two year school 


67.93 


1.27 


0.63 


5,433 


2.01 


4.02 


Has never married 


70.08 


1.11 


0.61 


5,602 


1.81 


3.29 


SUMMARY STATISTICS 














Mean 










1.40 


2.01 


Minimum 










1.08 


1.16 


Maximum 










2.01 


4.02 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7. 8. -Design effects for male respondents - B&B:93/94 



VARIABLES 


Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


27.44 


1.06 


0.67 


4,375 


1.57 


2.47 


Took state/profl licensing exams 


11.41 


0.65 


0.48 


4,355 


1.35 


1.82 


Applied for aid (of those applying for 














post-BA entrance) 


51.79 


1.87 


1.31 


1,446 


1.42 


2.03 


Attended school since graduation 


27.25 


0.84 


0.67 


4,371 


1.25 


1.56 


Received aid (of those who attended 














school since receiving BA) 


62.29 


2.20 


1.76 


755 


1.25 


1.56 


Had prior related job experience 


45.20 


1.08 


0.76 


4,327 


1.43 


2.04 


Employed since BA 


95.22 


0.43 


0.32 


4,330 


1.33 


1.76 


Degree is required for job 


55.58 


1.13 


0.83 


3,596 


1.36 


1.86 


Received other similar job offers 


28.77 


1.01 


0.75 


3,625 


1.34 


1.80 


Degree is related to job 


51.40 


1.12 


0.83 


3,626 


1.35 


1.82 


R's job has career potential 


43.78 


1.09 


0.83 


3,615 


1.32 


1.74 


R's job offers health insurance 


77.11 


0.89 


0.70 


3,614 


1.27 


1.62 


Considered teaching 


22.32 


0.87 


0.63 


4,305 


1.37 


1.88 


Received training from employer 


34.49 


1.12 


0.79 


3,605 


1.41 


2.00 


Has done volunteer work 


32.88 


1.05 


0.72 


4,290 


1.46 


2.14 


Voted in '92 presidential election 


76.70 


0.94 


0.64 


' 4,344 


1.47 


2.15 


Speaks a foreign language 


59.51 


1.12 


0.75 


4,274 


1.49 


2.23 


Has children 


14.68 


0.98 


0.54 


4,280 


1.81 


3.28 


Is saving money 


70.89 


0.88 


0.70 


4,243 


1.26 


1.59 


Has educational loan(s) 


38.69 


1.11 


0.75 


4,239 


1.48 


2.20 


Owns home 


18.31 


0.96 


0.59 


4,248 


1.62 


2.62 


Owns car 


83.43 


0.86 


0.57 


4,243 


1.51 


2.27 


Has non-educational debt 


45.14 


1,08 


0.77 


4,220 


1.41 


1.99 


Has graduate school loan(s) 


4.88 


0.37 


0.33 


4,371 


1.14 


1.29 


Is disabled 


96.02 


0.39 


0.30 


4,328 


1.31 


1.72 


Has held multiple jobs 


67.17 


1.11 


0.73 


4,093 


1.51 


2.29 


Any unemployment since graduation 


70.28 


0.87 


0.69 


4,375 


1.26 


1.59 


Applied to graduate school 


69.74 


0.99 


0.69 


4,375 


1.43 


2.03 


Attended a two year school 


70.15 


1.44 


0.71 


4,201 


2.04 


4.16 


Has never married 


75.18 


1.09 


0.66 


4,321 


1.66 


2.75 


SUMMARY STATISTICS 














Mean 










1.43 


2.07 


Minimum 










1.14 


1.29 


Maximum 










2.04 


4.16 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7.9.~Design effects for black respondents - B&B:93/94 





Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


27.51 


2.61 


1.82 


605 


1.44 


2.07 


Took state/profl licensing exams 


6.54 


1.05 


1.01 


601 


1.04 


1.08 


Applied for aid (of those applying for 














post-BA entrance) 


49.15 


3.86 


3.20 


244 


1.21 


1.45 


Attended school since graduation 


24.27 


1.96 


1.74 


605 


1.12 


1.26 


Received aid (of those who attended 














school since receiving BA) 


72.24 


5.03 


4.37 


105 


1.15 


1.32 


Had prior related job experience 


44.48 


2.67 


2.04 


595 


1.31 


1.72 


Employed since BA 


93.11 


1.30 


1.04 


594 


1.25 


1.56 


Degree is required for job 


49.36 


3.31 


2.26 


488 


1.46 


2.14 


Received other similar job offers 


25.97 


2.58 


1.98 


488 


1.30 


1.69 


Degree is related to job 


48.94 


2.85 


2.26 


488 


1.26 


1.59 


R's job has career potential 


31.28 


2.41 


2.11 


485 


1.14 


1.31 


R's job offers health insurance 


27.51 


2.71 


1.91 


484 


1.42 


2.00 


Considered teaching 


6.54 


2.74 


2.01 


586 


1.36 


1.86 


Received training from employer 


49.15 


2.32 


2.08 


486 


1.12 


1.25 


Has done volunteer work 


24.27 


2.70 


2.05 


586 


1.32 


1.73 


Voted in '92 presidential election 


72.24 


2.23 


1.73 


600 


1.29 


1.66 


Speaks a foreign language 


44.48 


2.98 


2.02 


584 


1.48 


2.19 


Has children 


93.11 


2.53 


1.88 


583 


1.34 


1.81 


Is saving money 


49.36 


2.42 


1.87 


571 


1.30 


1.68 


Has educational loans 


25.97 


2.88 


2.09 


573 


1.38 


1.91 


Owns home 


17.31 


2.55 


1.57 


579 


1.62 


2.63 


Owns car 


67.77 


2.35 


1.95 


577 


1.21 


1.46 


Has non-educational debt 


60.99 


2.51 


2.04 


573 


1.23 


1.52 


Has graduate loans 


5.55 


1.14 


0.93 


605 


1.22 


1.50 


Is disabled 


2.22 


0.74 


0.60 


595 


1.23 


1.50 


Has held multiple jobs 


36.84 


2.63 


2.06 


550 


1.28 


1.63 


Any unemployment since graduation 


31.77 


2.27 


1.89 


605 


1.20 


1.44 


Applied to graduate school 


36.01 


2.40 


1.95 


605 


1.23 


1.51 


Attended a two year school 


75.61 


2.54 


1.79 


575 


1.42 


2.01 


Has never married 


80.24 


2.32 


1.63 


594 


1.42 


2.02 


SUMMARY STATISTICS 














Mean 










1.29 


1.68 


Minimum 










1.04 


1.08 


Maximum 










1.62 


2.63 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7. 10. -Design effects for Asian respondents - B&B:93/94 





Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


24.04 


4.91 


2.06 


429 


2.38 


5.66 


Took state/prof 1 licensing exams 


9.82 


1.84 


1.44 


425 


1.27 


1.62 


Applied for aid (of those applying for 














post-BA entrance) 


55.64 


7.62 


3.78 


173 


2.02 


4.07 


Attended school since graduation 


29.18 


3.08 


2.19 


429 


1.40 


1.97 


Received aid (of those who attended 














school since receiving BA) 


48.74 


6.46 


5.39 


86 


1.20 


1.44 


Had prior related job experience 


42.94 


4.17 


2.40 


427 


1.74 


3.03 


Employed since BA 


88.89 


2.03 


1.52 


427 


1.33 


1.78 


Degree is required for job 


60.39 


4.93 


2.76 


313 


1.78 


3.18 


Received other similar job offers 


26.38 


3.25 


2.49 


314 


1.31 


1.71 


Degree is related to job 


48.42 


4.90 


2.82 


314 


1.74 


3.02 


R's job has career potential 


28.62 


3.70 


2.56 


312 


1.45 


2.09 


R’s job offers health insurance 


78.84 


3.48 


2.31 


312 


1.50 


2.26 


Considered teaching 


11.75 


1.85 


1.57 


423 


1.18 


1.40 


Received training from employer 


35.61 


5.67 


2.70 


314 


2.10 


4.40 


Has done volunteer work 


32.53 


4.73 


2.28 


421 


2.07 


4.29 


Voted in ’92 presidential election 


44.02 


4.09 


2.41 


423 


1.69 


2.87 


Speaks a foreign language 


24.54 


3.42 


2.10 


419 


1.63 


2.65 


Has children 


8.92 


2;00 


1.39 


421 


1.44 


2.07 


Is saving money 


58.59 


4.06 


2.41 


417 


1.68 


2.83 


Has educational loans 


30.48 


4.84 


2.27 


413 


2.14 


4.57 


Owns home 


13.87 


2.51 


1.69 


416 


1.48 


2.19 


Owns car 


62.36 


4.10 


2.38 


416 


1.73 


2.98 


Has non-educational debt 


33.49 


4.71 


2.32 


414 


2.03 


4.12 


Has graduate loan(s) 


3.76 


0.97 


0.92 


429 


1.06 


1.12 


Is disabled 


2.15 


0.87 


0.71 


423 


1.23 


1.52 


Has held multiple jobs 


27.91 


5.41 


2.34 


369 


2.32 


5.37 


Any unemployment since graduation 


31.01 


3.04 


2.23 


429 


1.36 


1.85 


Applied to graduate school 


40.16 


4.12 


2.37 


429 


1.74 


3.03 


Attended a two year school 


77.76 


3.24 


2.08 


400 


1.56 


2.43 


Has never married 


86.29 


2.19 


1.67 


424 


1.31 


1.72 


SUMMARY STATISTICS 














Mean 










1.63 


2.78 


Minimum 










1.06 


1.12 


Maximum 










2.38 


5.66 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7.1 1.— Design effects for Hispanic respondents - B&B:93/94 





Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


30.71 


2.52 


2.02 


524 


1.25 


1.56 


Took state/profl licensing exams 


13.59 


2.39 


1.50 


524 


1.60 


2.55 


Applied for aid (of those applying for 














post-BA entrance) 


49.36 


4.97 


3.80 


173 


1.31 


1.71 


Attended school since graduation 


29.42 


2.64 


1.99 


524 


1.33 


1.76 


Received aid (of those who attended 














school since receiving BA) 


63.17 


7.44 


5.23 


85 


1.42 


2.02 


Had prior related job experience 


42.07 


2.92 


2.17 


517 


1.34 


1.81 


Employed since BA 


92.66 


1.33 


1.15 


518 


1.16 


1.35 


Degree is required for job 


58.25 


3.44 


2.42 


416 


1.42 


2.02 


Received other similar job offers 


26.39 


2.37 


2.15 


421 


1.10 


1.22 


Degree is related to job 


55.22 


3.08 


2.43 


420 


1.27 


1.61 


R's job has career potential 


39.49 


3.46 


2.39 


417 


1.45 


2.09 


R's job offers health insurance 


75.90 


2.66 


2.09 


417 


1.27 


1.61 


Considered teaching 


32.43 


2.86 


2.07 


511 


1.38 


1.91 


Received training from employer 


34.46 


2.96 


2.32 


418 


1.27 


1.62 


Has done volunteer work 


30.15 


2.65 


2.04 


508 


1.30 


1.69 


Voted in '92 presidential election 


62.13 


3.04 


2.13 


521 


1.43 


2.05 


Speaks a foreign language 


15.84 


2.35 


1.62 


506 


1.45 


2.10 


Has children 


24.97 


2.92 


1.92 


508 


1.52 


2.31 


Is saving money 


69.31 


2.59 


2.05 


505 


1.26 


1.59 


Has educational loans 


48.79 


3.37 


2.23 


502 


1.51 


2.28 


Owns home 


23.96 


3.01 


1.90 


507 


1.59 


2.52 


Owns car 


81.15 


2.27 


1.74 


505 


1.30 


1.70 


Has non-educational debt 


51.35 


3.14 


2.23 


501 


1.41 


1.98 


Has graduate loan(s) 


3.77 


0.96 


0.83 


524 


1.15 


1.33 


Is disabled 


3.58 


1.06 


0.82 


516 


1.30 


1.68 


Has held multiple jobs 


31.59 


3.03 


2.13 


475 


1.42 


2.02 


Any unemployment since graduation 


30.29 


2.70 


2.01 


524 


1.35 


1.81 


Applied to graduate school 


29.46 


2.57 


1.99 


524 


1.29 


1.67 


Attended a two year school 


66.05 


3.15 


2.15 


484 


1.46 


2.14 


Has never married 


69.64 


2.60 


2.02 


516 


1.28 


1.65 


SUMMARY STATISTICS 














Mean 










1.35 


1.85 


Minimum 










1.10 


1.22 


Maximum 










1.60 


2.55 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7. 12. --Design effects for white respondents - B&B:93/94 




Percent 

estimate Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


28.94 


0.82 


0.50 


8,375 


1.65 


2.74 


Took state/prof 1 licensing exams 


13.73 


0.55 


0.38 


8,330 


1.46 


2.13 


Applied for aid (of those applying for 














post-BA entrance) 


51.37 


1.33 


1.00 


2,511 


1.33 


1.78 


Attended school since graduation 


27.29 


0.66 


0.49 


8,365 


1.36 


1.84 


Received aid (of those who attended 














school since receiving BA) 


61.41 


1.73 


1.34 


1,317 


1.29 


1.66 


Had prior related job experience 


47.96 


0.76 


0.55 


8,287 


1.38 


1.92 


Employed since BA 


95.54 


0.30 


0.23 


8,295 


1.32 


1.75 


Degree is required for job 


55.98 


0.75 


0.59 


7,071 


1.27 


1.61 


Received other similar job offers 


29.76 


0.73 


0.54 


7,123 


1.35 


1.82 


Degree is related to job 


55.39 


0.77 


0.59 


7,129 


1.31 


1.71 


R’s job has career potential 


41.29 


0.76 


0.58 


7,108 


1.30 


1.69 


R’s job offers health insurance 


76.17 


0.63 


0.51 


7,105 


1.25 


1.55 


Considered teaching 


30.33 


0.68 


0.51 


8,245 


1.34 


1.80 


Received training from employer 


34.38 


0.69 


0.56 


7,079 


1.22 


1.49 


Has done volunteer work 


35.09 


0.70 


0.53 


8,210 


1.33 


1.77 


Voted in '92 presidential election 


80.89 


0.65 


0.43 


8,335 


1.51 


2.28 


Speaks a foreign language 


64.51 


0.77 


0.53 


8,187 


1.46 


2.12 


Has children 


17.56 


0.82 


0.42 


8,203 


1.95 


3.81 


Is saving money 


71.87 


0.63 


0.50 


8,141 


1.26 


1.60 


Has educational loans 


37.39 


0.83 


0.54 


8,136 


1.55 


2.39 


Owns home 


22.60 


0.87 


0.46 


8,146 


1.88 


3.52 


Owns car 


84.52 


0.68 


0.40 


8,145 


1.70 


2.88 


Has non-educational debt 


47.28 


0.75 


0.55 


8,102 


1.35 


1.83 


Has graduate loan(s) 


4.58 


0.27 


0.23 


8,365 


1.18 


1.40 


Is disabled 


3.44 


0.25 


0.20 


8,279 


1.25 


1.56 


Has held multiple jobs 


34.64 


0.67 


0.54 


7,901 


1.25 


1.57 


Any unemployment since graduation 


28.26 


0.67 


0.49 


8,375 


1.36 


1.85 


Applied to graduate school 


27.39 


0.68 


0.49 


8,375 


1.40 


1.95 


Attended a two year school 


68.23 


1.27 


0.52 


8,045 


2.45 


5.99 


Has never married 


71.24 


0.98 


0.50 


8,262 


1.97 


3.87 


SUMMARY STATISTICS 














Mean 










1.46 


2.20 


Minimum 










1.18 


1.40 


Maximum 










2.45 


5.99 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7.1 3. -Design effects for respondents at 4-year public institutions - B&B:93/94 





Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


28.87 


0.93 


0.56 


6,563 


1.66 


2.76 


Took state/prof 1 licensing exams 


14.31 


0.61 


0.43 


6,530 


1.41 


1.98 


Applied for aid (of those applying for 














post-BA entrance) 


49.24 


1.49 


1.13 


1,945 


1.31 


1.73 


Attended school since graduation 


27.99 


0.75 


0.55 


6,559 


1.35 


1.83 


Received aid (of those who attended 














school since receiving BA) 


60.58 


1.78 


1.54 


1,008 


1.16 


1.34 


Had prior related job experience 


45.23 


0.80 


0.62 


6,494 


1.30 


1.68 


Employed since BA 


95.15 


0.35 


0.27 


6,498 


1.31 


1.72 


Degree is required for job 


56.94 


0.89 


0.67 


5,519 


1.34 


1.78 


Received other similar job offers 


29.02 


0.79 


0.61 


5,559 


1.30 


1.68 


Degree is related to job 


56.11 


0.88 


0.67 


5,564 


1.32 


1.75 


R's job has career potential 


41.51 


0.85 


0.66 


5,547 


1.28 


1.65 


R's job offers health insurance 


76.76 


0.74 


0.57 


5,539 


1.30 


1.70 


Considered teaching 


30.39 


0.75 


0.57 


6,458 


1.31 


1.72 


Received training from employer 


34.42 


0.79 


0.64 


5,537 


1.24 


1.53 


Has done volunteer work 


33.45 


0.76 


0.59 


6,434 


1.29 


1.67 


Voted in '92 presidential election 


77.82 


0.77 


0.51 


6,516 


1.50 


2.24 


Speaks a foreign language 


61.40 


0.95 


0.61 


6,410 


1.56 


2.44 


Has children 


16.87 


0.83 


0.47 


6,419 


1.78 


3.15 


Is saving money 


72.08 


0.68 


0.56 


6,365 


1.21 


1.46 


Has educational loans 


36.06 


0.95 


0.60 


6,360 


1.58 


2.49 


Owns home 


21.12 


0.90 


0.51 


6,371 


1.76 


3.10 


Owns car 


84.66 


0.72 


0.45 


6,375 


1.60 


2.54 


Has non-educational debt 


49.21 


0.80 


0.63 


6,346 


1.27 


1.62 


Has graduate loan(s) 


4.42 


0.31 


0.25 


6,559 


1.22 


1.49 


Is disabled 


3.44 


0.29 


0.23 


6,478 


1.28 


1.64 


Has held multiple jobs 


34.70 


0.76 


0.61 


6,159 


1.25 


1.57 


Any unemployment since graduation 


29.40 


0.73 


0.56 


6,563 


1.30 


1.68 


Applied to graduate school 


27.70 


0.77 


0.55 


6,563 


1.39 


1.94 


Attended a two year school 


67.26 


1.56 


0.59 


6,307 


2.64 


6.97 


Has never married 


71.45 


1.02 


0.56 


6,464 


1.82 


3.30 


SUMMARY STATISTICS 














Mean 










1.43 


2.14 


Minimum 










1.16 


1.34 


Maximum 










2.64 


6.97 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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Table 7.14.— Design effects for respondents at 4-year private institutions - B&B:93/94 





Percent 

estimate 


Design SE 


SRS SE 


N 


DEFT 


DEFF 


Received other degree before BA 


27.21 


1.43 


0.76 


3,421 


1.88 


3.53 


Took state/profl licensing exams 


11.02 


0.76 


0.54 


3,401 


1.42 


2.00 


Applied for aid (of those applying for 














post-BA entrance) 


53.42 


1.49 


1.45 


1,191 


1.03 


1.06 


Attended school since graduation 


26.66 


0.99 


0.76 


3,415 


1.31 


1.71 


Received aid (of those who attended 














school since receiving BA) 


65.32 


2.37 


1.94 


600 


1.22 


1.49 


Had prior related job experience 


50.55 


1.21 


0.86 


3,374 


1.41 


1.98 


Employed since BA 


94.23 


0.53 


0.40 


3,373 


1.32 


1.74 


Degree is required for job 


54.25 


1.33 


0.94 


2,787 


1.41 


1.99 


Received other similar job offers 


29.57 


1.11 


0.86 


2,806 


1.29 


1.66 


Degree is related to job 


52.84 


1.28 


0.94 


2,806 


1.36 


1.84 


R’s job has career potential 


37.98 


1.20 


0.92 


2,794 


1.31 


1.71 


R's job offers health insurance 


75.06 


0.74 


0.58 


5,539 


1.27 


1.62 


Considered teaching 


30.20 


0.75 


0.79 


3,343 


0.94 


0.89 


Received training from employer 


34.48 


1.23 


0.90 


2,777 


1.36 


1.86 


Has done volunteer work 


38.37 


1.16 


0.84 


3,322 


1.37 


1.89 


Voted in '92 presidential election 


78.59 


0.77 


0.70 


3,393 


1.09 


1.20 


Speaks a foreign language 


56.89 


1.44 


0.86 


3,313 


1.67 


2.80 


Has children 


21.29 


1.69 


0.71 


3,325 


2.38 


5.67 


Is saving money 


68.75 


1.13 


0.81 


3,295 


1.40 


1.96 


Has educational loans 


43.52 


1.30 


0.86 


3,292 


1.50 


2.26 


Owns home 


23.09 


1.72 


0.73 


3,303 


2.35 


5.50 


Owns car 


77.39 


1.60 


0.73 


3,293 


2.19 


4.82 


Has non-educational debt 


43.37 


1.33 


0.87 


3,270 


1.53 


2.36 


Has graduate loan(s) 


5.15 


0.40 


0.38 


3,415 


1.06 


1.12 


Is disabled 


3.14 


0.29 


0.30 


3,368 


0.97 


0.93 


Has held multiple jobs 


32.86 


1.15 


0.83 


3,167 


1.38 


1.90 


Any unemployment since graduation 


29.40 


0.73 


0.78 


3,421 


0.94 


0.88 


Applied to graduate school 


31.27 


1.15 


0.79 


3,421 


1.45 


2.11 


Attended a two year school 


72.85 


1.67 


0.78 


3,240 


2.14 


4.57 


Has never married 


74.58 


1.94 


0.54 


3,363 


2.58 


6.68 


SUMMARY STATISTICS 














Mean 










1.52 


2.60 


Minimum 










0.94 


0.88 


Maximum 










3.58 


6.68 



SOURCE: NCES, Baccalaureate and Beyond:93/94 
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SAMPLE ADVANCE LETTER 



May 1994 

[NAME] 

[ADDRESS] 

[CITY, STATE, ZIP] 

Dear [NAME]: 

You have been selected to be part of the Baccalaureate and Beyond Study, or B&B, an 
important study of college graduates sponsored by the U.S. Department of Education. As such, 
you will represent hundreds of other graduates like you. 

The B&B study is designed to follow college graduates through further education and 
career choices. The study will build upon the information collected in the National Postsecondary 
Student Aid Study (NPSAS), for which you were interviewed not long ago. Whereas, NPSAS 
focused on your experience as an undergraduate student, B&B will collect information about your 
employment and education experiences after graduation. 

The B&B study is being conducted by the National Opinion Research Center (NORC), at 
the University of Chicago. The interview will take about 35 minutes, although many interviews 
will be shorter than that depending upon individual experiences. 

Both NORC and the National Center for Education Statistics will assure that your privacy 
is protected. New federal laws provide stiff fines and prison sentences for the disclosure of your 
identity or the misuse of information you provide to us. Please see the back of this letter for 
additional information about our uncompromising pledge of confidentiality protection. 

An interviewer from NORC will telephone you soon. We thank you for your 
participation. If you have questions or would like to arrange an interview time, please call the 
study at its toll-free number, 1 (800) 597-7870, and ask for the B&B Coordinator. NORC's 
general number is (312) 753-7500. The Project Director is Mr. Howard Speizer. 



Sincerely, 



Paula Knepper, Ph.D. 

Project Officer 

Postsecondary Longitudinal Studies 



Enclosure: 



B&B information leaflet 
[CA5EID] 



NORCCO 



ci am 



ENTIALITY PLEDGE 



As a matter of policy, NORC and the National Center for Education Statistics, of the U.S. 

Department of Education, are concerned with protecting the privacy of individuals who 

participate in voluntary surveys. We want to let you know that: 

1 . The collection of information in this survey is authorized by Section 406 of the General 
Education Provisions Act (20-USC-1221e-l) and Public Law 100-297. 

2. We are asking these questions in order to gather information about the experiences of 
college graduates after they leave college and move on to graduate or professional 
education, work, or other activities. 

3. Participation is voluntary. You may skip questions you do not wish to answer; however, 
we hope that you will answer as many questions as you can. 

4. No information collected under this authority may be used for any purpose other than the 
purpose for which it was supplied. Information will be protected from disclosure by 
federal statute (42 US Code 242m, section 308d). NCES may use the data only for 
statistical purposes and violators are subject to fines and imprisonment for misuse. Data 
will be combined to produce statistical reports for Congress and others. No individual 
data that links your name, address, telephone number, or student identification number 
with your responses will be reported. 
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August, 1994 



IBM 

Dear|iil2| 

An interviewer from the National Opinion Research Center at the University of Chicago called you 
recently on behalf of the National Center for Education Statistics (NCES), the research center within the U S. 
Department of Education. The interviewer asked you to participate in the Baccalaureate and Beyond Study 
(B&B), however, you did not wish to participate at that time. 

We want to talk to you because we are interested in learning about the impact of post-secondary 
education on the lives of those who attain a bachelor’s degree. The results of this study will provide Congress 
and the educators who recommend government policy with the information they need to decide on improvements 
in the quality of education in America. Your views and experiences are vital to the success of this study. You 
have helped NCES in the past with the National Postsecondary Student Aid Study; and we again ask for your 
assistance by your participation in B&B, so that we can effect constructive changes in the American educational 
system. All of your responses will be held in strict confidence and any information which could identify you will 
be separated from your interview. 

You may have participated in the National Postsecondary Student Aid Study (NPSAS) and remember 
the length and intricacy of that survey. We want you to know that the Baccalaureate and Beyond (B&B) survey 
takes only 30 minutes, on average, to complete; this is significantly shorter than the NPSAS interview. Also, the 
B&B interview has an entirely different focus than the NPSAS study; in B&B we are interested in your education 
and employment experiences after you received your bachelor's degree. 

We realize that you are very busy and that your time is valuable. All you need to do is answer the 
questions we ask over the telephone; you do not have to fill anything out. If necessaiy we can schedule several 
short appointments to fit your schedule, at times most convenient to you. 

I have asked one of our interviewers to call you soon. We would appreciate a few minutes of your time 
to explain the study and to arrange for an interview at your earliest convenience. I sincerely hope that we have 
stressed the importance of your contribution to this study. Please call the B&B Coordinator toll-free at 1-800- 

597-7870 if you have any questions about the study. 

* 

Sincerely, 



HS/rlp 



Howard Speizer 
Project Director 



TOO BUSY/NOT INTERESTED 
August, 1994 



Dear [RESPONDENT NAME]: 

An interviewer from the National Opinion Research Center at the University of Chicago called you 
recently on behalf of the U.S. Department of Education. The interviewer asked you to participate in the 
Baccalaureate and Beyond Study (B&B), however, you did not wish to participate at that time. 

We want to talk to you because we are interested in learning about the impact of post-secondary 
education on the lives of those who attain a bachelor's degree. The results of this study will provide Congress 
and the educators who recommend government policy with the information they need to decide on improvements 
in the quality of education in America. Your views and experiences are invaluable. You have helped us in the 
past with the National Postsecondary Student Aid Study; and we again ask for your assistance by your 
participation in B&B, so that we can effect constructive changes in the American educational system. All of your 
responses will be held in strict confidence and any information which could identify you will be separated from 
your interview. 

We realize that you are very busy and that your time is valuable. The interview takes about 35 minutes 
and all you need to do is answer the questions we ask over the telephone; you do not have to fill anything out. 
We can schedule multiple interviews to fit your schedule. We can also schedule an appointment for the most 
convenient time possible. 

I have asked one of our interviewers to call you soon. We would appreciate a few minutes of your time 
to explain the study and to arrange for an interview at your convenience. I sincerely hope that we have stressed 
the importance of your contribution to this study. Please call the B&B Coordinator toll-free at 1-800-597-7870 
if you have any questions about the study. 



Sincerely, 



Howard Speizer 
Project Director 



CONFIDENTIALITY 



August, 1994 



Dear [RESPONDENT]: 



An interviewer from the National Opinion Research Center at the University of Chicago called you 
recently on behalf of the U.S. Department of Education. The interviewer asked you to participate in the 
Baccalaureate and Beyond Study (B&B); however, you explained that you did not wish to complete the 
interview because you are concerned about the sensitive nature of some of the questions. 

Let me assure you that we provide rigorous protection of the privacy of all respondents in the study. 
All of your responses will be held in strict confidence and any information which could lde " l ^ ou /V 
separated from your interview. The results of the study are reported in only sununary or statistical form, 
addition to the strict confidentiality procedures we follow in our organization, the Privacy Act o 
ensures that the confidentiality of respondents in federally funded research projects is legally protected. If 
you are still apprehensive, please remember that you always have the option of refusing to answer certain 

questions during the interview. 



The results of this study will provide Congress and the educators who recommend government policy 
with the information they need to decide on improvements in the quality of education m America. Your views 
and experience as a college graduate are invaluable. You have helped us in the past with the National 
Postsecondary Student Aid Study; and we again ask for your assistance by your participation in B&B, so 
that we can effect constructive changes in the American educational system. 



I have asked one of our interviewers to call you soon. We would appreciate a few minutes of your 
time to explain the study and to arrange for an interview at your convenience. I sincerely hope that we have 
stressed the importance of your contributions to this study. Please call the B&B Coordinator toll-free at 1- 
800-597-7870 if you have any questions about the study. 



Sincerely, 



Howard Speizer 
Project Director 



ANTI-GOVERNMENT 



August, 1994 



Dear [RESPONDENT]: 

An interviewer from the National Opinion Research Center at the University of Chicago called you 
recently on behalf of the U.S. Department of Education. The interviewer asked you to participate in the 
Baccalaureate and Beyond Study (B&B); however, you explained that you were not interested in participating 
in a government study at that time. 

Although the National Center for Education Statistics sponsors the study, the National Opinion 
Research Center is a not-for-profit social science research center committed to conducting research in the 
public interest. We serve the public by collecting and reporting information about attitudes and behaviors of 
the American public. This can only be achieved when everyone who is randomly selected for a study 
participates. 

Your views and experience as a college student and graduate are invaluable. You have helped us in 
the past with the National Postsecondary Student Aid Study; and we again ask for your assistance by your 
participation in B&B, so that we can effect constructive changes in the American educational system. All of 
your responses will be held in strict confidence and any information which could identify you will be 
separated from your interview. The results of the study are reported in only summary or statistical form. 

I have asked one of our interviewers to call you shortly after you have received this letter. We would 
appreciate a few minutes of your time to explain the study and to arrange for an interview at your 
convenience. I sincerely hope that we have stressed the importance of your contribution to this study. Please 
call the B&B Coordinator toll-free at 1-800-597-7870 if you have any questions about the study. 

Sincerely, 



Howard Speizer 
Project Director 
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FOR QUESTIONS AX 13 THROUGH A020, 
ALL SKIP PATTERNS ARE NOTED IN 
THE FLOWCHART IN APPENDIX A. 

THE FLOWCHART ONLY CONTAINS 
SKIPS THAT ARE A RESULT OF A 
QUESTION BEING ASKED IN CATI. ALL 
SKIPS THAT REFER TO PRELOAD 
VARIABLES ARE IN THE SKIP PATTERN 
COLUMN OF THE DATA DICTIONARY, 
AND NOT IN THE FLOWCHART. 
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1= SKIP TO A137 
2= RETURN TO AJ23 
AND RE-ENTER 
USER EX IT 








1 =THIS IS CORRECT 

2 = NEED TO ADD/CORRECT SCHOOL 
OR ENROLLMENT PERIOD 


school index for enrollment #9 
beginning date (mmyy) for enrollment #9 
ending date (mmyy) for enrollment #9 
school index for enrollment #10 
beginning date (mmyy) for enrollment #10 
ending date (mmyy) for enrollment #10 
school index for enrollment #1 1 
beginning date (mmyy) for enrollment #1 1 
ending date (mmyy) for enrollment #1 1 
school index for enrollment #12 
beginning date (mmyy) for enrollment #12 
ending date (mmyy) for enrollment #12 


Enrollment information by school 
Number of enrollments 
beginning month of first enrollment 
beginning year of first enrollment 
ending month of first enrollment 
ending year of first enrollment 
beginning month of last enrollment 
beginning year of last enrollment 
ending month of last enrollment 
ending year of last enrollment 


cumulative time 
cumulative question count 


SUMMARY OF ENROLLMENT TERMS: 
SCHOOL NAMES BEG_DATE END_DATE 
(upto 12 enrollment terms) 


« ^ — 




TV08 :320/ 28 : 8 
CV08 :320/ 36 : 5 


A038 :362/ 43 : 1 


SF09 :354/ 26 : 
BD09 :354/ 27 
ED09 :354/31 
SF10 .354/ 35 
BDIO :354/ 36 
ED10 :354/40 
SF1 1 :354/ 44 
BD11 :354/45 
EDI 1 :354/ 49 
SF12 :354/ 53 
BD12 :354/ 54 
ED12 :354/ 58 
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IF NO SCHOOLS 
OTHER THAN 
SAMPLE SCHOOL 
ATTENDED 
BETWEEN 7/1/92 
AND 6/30/93, SKIP TO 
B105 




ASK FOR EACH 
SCHOOL, OTHER 
THAN SAMPLE 
SCHOOL, LISTED AT 
AJ23 




1 = SPECIFY MAJOR OR PROGRAM OF 
STUDY 

D,R 




1 = SELECT MAJOR OR PROGRAM OF 
STUDY 

D,R 


userexit status code 
CIP field of study coding 
verbatim text 

standard text from the coding dictionary 


And what was your major at SAMPLE 
SCHOOL during (INSERT LAST 
ENROLLMENT TERM)? 

INTERVIEWER: 

PLEASE ENTER THE MAJOR AND 
SELECT THE APPROPRIATE CODE IN 
THE USEREXIT. 


userexit status code 
CIP field of study coding 
verbatim text 

standard text from the coding dictionary 


What was your major at (SCHOOL NAME) 
between July 1 , 1992 and June 30, 1993? 

INTERVIEWER: 

PLEASE ENTER THE MAJOR AND 
SELECT THE APPROPRIATE CODE IN 
THE USEREXIT 


B2s0 :365/ 10 : 1 
B2a0 :365/ 11:3 
B2b0 :365/ 14 :70 
B2c0 :366/ 4 :50 


B1X2 :366/54 : 1 
(intro screen) 


B2t0 :366/ 55 : 1 
B2d0 :366/ 56 : 3 
B2e0 :366/ 59 :70 
B2f0 :367/ 49 :50 


BXX3 :368/ 19 : 1 
(school 1) 

BXY3 :369/ 64 : 1 
(school 2) 

BXZ3 :371 / 29 : 1 
(school 3) 

(intro screen) 




B1X2 




BXX3 

(BXY3.BXZ3) 
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IF NO SCHOOLS 
OTHER THAN 
SAMPLE SCHOOL 
ATTENDED 
BETWEEN 7/1/92 
AND 6/30/93, 
CONTINUE TO B106; 
IF MORE THAN ONE 
SCHOOL ATTENDED, 
SKIP TO B1J6 














userexit status code 
CIP field of study coding 
verbatim text 

standard text from the coding dictionary 


userexit status code 
CIP field of study coding 
verbatim text 

standard text from the coding dictionary 


userexit status code 
CIP field of study coding 
verbatim text 

standard text from the coding dictionary 




cumulative time 
cumulative question count 
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TVll :320/67 : 8 
CV11 :320/75 : 5 


bool 1: 
368/ 20 
368/ 21 
368/ 24 
369/ 14 
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INSTRUCTION 
BOX BOOS 
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2, D, R = SKIP TO 
C050 


1 = YES 

2 = NO 

$( ).00 
5 columns 

D.R 


1 = YES 

2 = NO 

S( ).00 
5 columns 

D, R 


For the 1992-93 school year, were your tuition 
and/or fees at SCHOOL NAME waived in part 
or in full? 

IF YES: 

About how much was waived? 


Of the amount awarded and accepted by you in 
1992-1993 for SCHOOL NAME, was any of it 
from loans, that is, borrowed money that you 
must reoav? Please do not include loans from 
family, friends, or relatives. 

IF YES: 

How much was the total amount of these loans? 


Sample school: 
C026 :388/ 65 : 1 
C027 :388/ 66 : 5 
Other schools: 
CC26 :396/ 28 : 1 
CC27 :396/ 29 : 5 


Sample school: 
C028 :388/ 71 : 1 
C029 :388/ 72 : 5 
Other schools: 
CC28 :396/ 34 : 1 
CC29 :396/ 35 : 5 
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2, D, R = SKIP TO 
CX82 


2, D, R = SKIP TO 
C061 




1 = YES 

2 = NO 

$( ).oo 

5 columns 

D, R 


1 = YES 
2= NO 

S( ).00 
6 columns 

D. R 


LOAN REVIEW: 

IF THE DIFFERENCE BETWEEN C028 
AND THE SUM OF C028, PART2 AND 
C046 AND C046, PART 2 IS GREATER 
THAN 10%, REVIEW WITH RESPONDENT 
THE TYPES OF LOANS AND THE 
AMOUNTS THAT WERE AWARDED. 


Of the amount awarded and accepted by you 
for 1992- 93 for SCHOOL NAME, was any of 
it from other types of financial assistance such 
as college work-study, fellowships, 
assistantships, or aid from the military? 

IF YES: 

How much was the total financial assistance 
you received from these sources? 


Of the $ (INSERT AMOUNT IN COSO), was 
any of the aid in the form of a college work- 
study program? 

IF YES: 

What was the amount? 




Sample school: 
C050 :392/ 16 : 1 
C05I :392/ 17 : 5 
Other schools: 
CC50 :399/ 59 : 1 
CC51 :399/ 60 :5 


Sample school: 
C052 :392/ 22 : 1 
CX52 :392/ 23 : 6 
Other schools: 
CC52 :399/ 65 : 1 
CY52 :399/ 66 : 6 


INSTRUCTION 
BOX C049 
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COS 2 
CC52 
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EACH SCORE 
MUST BE 
BETWEEN 200- 
800 




ce 

P 






ASK ONLY FOR 
TESTS WHICH = 1 IN 
F019. DO NOT ASK 
FOR THE GRE. 

IF GRE IN F019 = 1, 
CONTINUE TO FX21 
AFTER ASKING F021; 
OTHERWISE, SKIP 
TO F047. 






SCORE: 

(4 columns) 

D, R 


ENTER RESPONDENT SCORE FOR EACH 
COMPONENT: 

VERBAL: 

ANALYTICAL: 

QUANTITATIVE: 

D* 




What was your total or composite score on the 
(NTE/MAT/DAT/GMAT/LSAT/MCAT/ 
STE/MCATWT/OTHER TEST)? 


What was your score on the... 

...verbal component of the GRE? 
...analytical component of the GRE? 
...quantitative component of the GRE? 


cumulative time 
cumulative question count 


If taken: 

f2 1 b :4 1 7/ 12 : 4 
(NTE - score) 
f2lc :4 1 7/ 16 : 4 
(MAT - score) 
f21d :4 1 7/ 20 : 4 
(DAT - score) 
f21e :4 1 7/ 24 : 4 
(GMAT - score) 
f21f :417/ 28 : 4 
(LSAT - score) 
f21g :4 1 7/ 32 : 4 
(MCAT - score) 
meat :417/ 36 : 1 
(meat writing test) 
f2lh :4 1 7/ 37 : 4 
(STE - score) 
f21i :4 1 7/ 41 : 4 
(OTHER - score) 


f21v .*416/ 80 : 4 
(GRE - verbal score) 
f21m :4 1 7/ 4 : 4 
(GRE - analytical score) 
f21q :41 7/ 8 : 4 
(GRE - quantitative 
score) 


TV33 :324/33 : 8 
CV33 :324/ 41 : 5 


F021 

(FJ19UXT) 


p 
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B&B ONLY 

2, D, R = SKIP TO 
INSTRUCTION BOX 
F80A 


B&B ONLY 




IF F061 OR F069 OR 
F074 = 1 , THEN 
CONTINUE TO FJ80; 
OTHERWISE, SKIP 
TOF083 


B&B ONLY 


l 


1 = YES 

2 = NO 
D,R 


1 = YES 

2 = NO 

3 = HAVENT HEARD YET/DON T 
KNOW 

R 






1 = SPECIFY MAJOR OR PROGRAM OF 
STUDY 

D,R 




Did you apply for financial aid at [SCHOOL 
NAME IN FJ75]? Please include research and 
teaching assistantships. 


Have you been awarded or offered financial aid 
at [SCHOOL NAME IN FJ75]? 


cumulative time 
cumulative question count 




What academic program will you be pursuing? 

INTERVIEWER: 

ENTER MAJOR HERE AND, IF 
NECESSARY, SELECT CODE IN THE 
USEREXIT. 


userexit status code 
CIP field of study coding 
verbatim text 

standard text from the coding dictionary 


F078 :424/ 63 : 1 


F079 :424/ 64 : 1 


TV35 :324/ 59 : 8 
CV35 :324/ 67 : 5 




FJ80 :425/ 14 : 1 


F80s :425/ 15 : 1 
F80a :425/ 16 : 3 
F80b :425/ 19 :70 
F80z :426/ 9 :50 


F078 

(Part of 
FJ57UXT) 


F079 

(Part of 
FJ57UXT) 

— 


Timestamp 


INSTRUCTION 
BOX F80A 


FJ80 
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NOTE: Professional degrees do not include degrees 
in cosmetology, truck driving, radio or 
refrigerator repair, et cetera. 
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Consolidated loan: A Loan formed by combining 
several loans from various sources into one. 
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Graduated repayment: repayment period is fixed and 
payment amounts gradually increase throughout the 
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